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Preface 

At Georgia Tech, MATH 3012: Applied Combinatorics, is a junior-level course tar- 
geted primarily at students pursuing the B.S. in Computer Science. The purpose of 
the course is to give students a broad exposure to combinatorial mathematics, using 
applications to emphasize fundamental concepts and techniques. Applied Combina- 
torics is also required of students seeking the B.S. in Applied Mathematics or the B.S 
in Discrete Mathematics, and it is one of two discrete mathematics courses that com- 
puter engineering students may select to fulfill a breadth requirement. The course will 
also often contain a selection of other engineering and science majors who are inter- 
ested in learning more mathematics. As a consequence, in a typical semester, some 
250 Georgia Tech students are enrolled in Applied Combinatorics. Students enrolled 
in Applied Combinatorics at Georgia Tech have already completed the three semester 
calculus sequence — with many students bypassing one or more of the these courses 
on the basis of advanced placement scores. Also, the students will know some linear 
algebra and can at least have a reasonable discussion about vector spaces, bases and 
dimension. 

Our approach to the course is to show students the beauty of combinatorics and 
how combinatorial problems naturally arise in many settings, particularly in computer 
science. While proofs are periodically presented in class, the course is not intended to 
teach students how to write proofs; there are other required courses in our curriculum 
that meet this need. Students may occasionally be asked to prove small facts, but these 
arguments are closer to the kind we expect from students in second or third semester 
calculus as contrasted with proofs we expect from a mathematics major in an upper- 
division course. Regardless, we cut very few corners, and our text can readily be used 
by instructors who elect to be even more rigorous in their approach. 

This book arose from our feeling that a text that met our approach to Applied Com- 
binatorics was not available. Because of the diverse set of instructors assigned to the 
course, the standard text was one that covered every topic imaginable (and then some), 
but provided little depth. We've taken a different approach, attacking the central sub- 
jects of the course description to provide exposure, but taking the time to go into 
greater depth in select areas to give the students a better feel for how combinatorics 
works. We have also included some results and topics that are not found in other texts 
at this level but help reveal the nature of combinatorics to students. We want students 
to understand that combinatorics is a subject that you must feel "in the gut", and we 
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hope that our presentation achieves this goal. The emphasis throughout remains on 
applications, including algorithms. We do not get deeply into the details of what it 
means for an algorithm to be "efficient", but we do include an informal discussion of 
the basic principles of complexity, intended to prepare students in computer science, 
engineering and applied mathematics for subsequent coursework. 

The materials included in this book have evolved over time. Early versions of a few 
chapters date from 2004, but the pace quickened in 2006 when the authors team taught 
a large section of Applied Combinatorics. In the last five years, existing chapters have 
been updated and expanded, while new chapters have been added. As matters now 
stand, our book includes more material than we can cover in a single semester. We 
feel that the topics of Chapters 1-9 plus Chapters 12, 13 and 14 are the core of a one 
semester course in Applied Combinatorics. Additional topics can then be selected from 
the remaining chapters based on the interests of the instructor and students. 

Mitchel T. Keller and William T. Trotter 
Lexington, Virginia, and Atlanta, Georgia 



Preface to 2016 Edition 

In April 2016, the American Institute of Mathematics hosted a weeklong workshop in 
San Jose to introduce authors of open textbooks to git and Robert A. Beezer's Math- 
Book xml authoring language designed to seamlessly produce html, DTpX, and other 
formats from a common xml source file. I (mtk) attended and eagerly began the con- 
version of existing DTgX source for this now decade-old project into MathBook xml. 
David Farmer deserves an enormous amount of credit for automating much of the 
process through a finely-tuned script, but the code produced still required a good deal 
of cleanup. This edition, the first not labeled "preliminary", will hopefully become the 
first of many annual editions of Applied Combinatorics released under an open source 
license. 

The main effort in producing this 2016 edition was to successfully convert to Math- 
Book xml. Along the way, I attempted to correct all typographical errors we had noted 
in the past. There are undoubtedly more errors (typographical or otherwise) that will 
be corrected in future years, so please contact us via email if you spot any. The text now 
has an index, which may prove more helpful than searching PDF files when looking 
for the most essential locations of some common terms. Since MathBook xml makes it 
easy, we now also have a list of notation. Instructors will likely be glad to know that 
there were no changes to the exercises, so lists of assigned exercises from past years 
remain completely valid. 1 The only significant changes to the body of the text was to 
convert wtt's code snippets from C to Python/ SageMath. This has allowed us to em- 
bed interactive SageMath cells that readers who use the html version of the text can 
run and edit. We've only scratched the surface with this powerful feature of MathBook 
xml, so look for more SageMath additions in future years. 

The conversion to MathBook xml allows us to make a wider variety of formats avail- 
able: 

• html: With responsive design using css, we feel that the text now looks beautiful 
on personal computers, tablets, and even mobile phones. No longer will students 
be frantically resizing a PDF on their phone in order to try to read a passage from 
the text. The "knowls" offered in html also allow references to images, tables, and 

1 There are two exceptions to this. The first is that Exercise 8.8.7 has been modified to make the computations 
involved cleaner. We have preserved the exercise that was previously in this position as Exercise 8.8.27 
and added a hint. The second is that a coefficient was changed in Exercise 9.9.15 to make the exercise 
feasible. 
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even theorems from other pages (or even a distance away on the same page) to 
provide a copy of the image /table /theorem right there, and another click /tap 
makes it disappear. 

• pdf: Not much is changed here from previous years, other than the pdf is pro- 
duced from the ETgX that MathBook xml generates, and so numbering and order 
is consistent with the html version. 

• Print: Campus bookstores have frequently produced printed versions of the text 
from the pdf provided online, but we have not previously been able to provide 
a printed, bound version for purchase. With the 2016 edition, we are pleased to 
launch a print version available through a number of online purchase channels. 
Campus bookstores may also acquire the book through wholesale channels for 
sale directly to students. Because of the CreativeCommons license under which 
the text is released, campuses retain the option of selling their own printed ver- 
sion of the text for students, although this is likely only financially advantageous 
to students if only a few chapters of the text are being used. 

We have some ideas for what might be updated for the 2017 Edition (e.g.. Chapter 4 
needs to be expanded both in the body and the exercises. Chapter 8 would benefit from 
integration of SageMath to assist with generating function computations, and Chap- 
ter 16 is still not really finished). However, we would love to hear from those of you 
who are using the text, too. Are there additional topics you'd like to see added? Chap- 
ters in need of more exercises? Topics whose exposition could be improved? Please 
reach out to us via email, and we'll consider your suggestions. 

Mitchel T. Keller 
Lexington, Virginia 


xvi 


Contents 


About the Authors vii 

Acknowledgements ix 

Preface xi 

Preface to 2016 Edition xiii 

Prologue 1 

1 An Introduction to Combinatorics 3 

1.1 Introduction 3 

1.2 Enumeration 4 

1.3 Combinatorics and Graph Theory 5 

1 .4 Combinatorics and Number Theory 8 

1.5 Combinatorics and Geometry 11 

1.6 Combinatorics and Optimization 13 

1.7 Sudoku Puzzles 15 

1.8 Discussion 16 

2 Strings, Sets, and Binomial Coefficients 17 

2.1 Strings: A First Look 17 

2.2 Permutations 19 

2.3 Combinations 21 

2.4 Combinatorial Proofs 23 

2.5 The Ubiquitous Nature of Binomial Coefficients 25 

2.6 The Binomial Theorem 29 

2.7 Multinomial Coefficients 29 

2.8 Discussion 31 

2.9 Exercises 32 

3 Induction 39 

3.1 Introduction 39 

3.2 The Positive Integers are Well Ordered 40 

xvii 


Contents 


3.3 The Meaning of Statements 40 

3.4 Binomial Coefficients Revisited 42 

3.5 Solving Combinatorial Problems Recursively 43 

3.6 Mathematical Induction 48 

3.7 Inductive Definitions 49 

3.8 Proofs by Induction 50 

3.9 Strong Induction 53 

3.10 Discussion 54 

3.11 Exercises 56 

4 Combinatorial Basics 59 

4.1 The Pigeon Hole Principle 59 

4.2 An Introduction to Complexity Theory 60 

4.3 The Big "Oh" and Little "Oh" Notations 63 

4.4 Exact Versus Approximate 64 

4.5 Discussion 66 

4.6 Exercises 67 

5 Graph Theory 69 

5.1 Basic Notation and Terminology for Graphs 69 

5.2 Multigraphs: Loops and Multiple Edges 74 

5.3 Eulerian and Hamiltonian Graphs 75 

5.4 Graph Coloring 80 

5.5 Planar Graphs 88 

5.6 Counting Labeled Trees 96 

5.7 A Digression into Complexity Theory 100 

5.8 Discussion 101 

5.9 Exercises 102 

6 Partially Ordered Sets 113 

6.1 Basic Notation and Terminology 114 

6.2 Additional Concepts for Posets 119 

6.3 Dilworth's Chain Covering Theorem and its Dual 122 

6.4 Linear Extensions of Partially Ordered Sets 125 

6.5 The Subset Lattice 126 

6.6 Interval Orders 128 

6.7 Finding a Representation of an Interval Order 129 

6.8 Dilworth's Theorem for Interval Orders 131 

6.9 Discussion 133 

6.10 Exercises 134 


xviii 



Contents 


7 Inclusion-Exclusion 141 

7.1 Introduction 141 

7.2 The Inclusion-Exclusion Formula 144 

7.3 Enumerating Surjections 145 

7.4 Derangements 147 

7.5 The Euler cp Function 149 

7.6 Discussion 151 

7.7 Exercises 152 

8 Generating Functions 157 

8.1 Basic Notation and Terminology 157 

8.2 Another look at distributing apples or folders 159 

8.3 Newton's Binomial Theorem 162 

8.4 An Application of the Binomial Theorem 164 

8.5 Partitions of an Integer 165 

8.6 Exponential generating functions 167 

8.7 Discussion 170 

8.8 Exercises 171 

9 Recurrence Equations 179 

9.1 Introduction 179 

9.2 Linear Recurrence Equations 182 

9.3 Advancement Operators 183 

9.4 Solving advancement operator equations 186 

9.5 Formalizing our approach to recurrence equations 194 

9.6 Using generating functions to solve recurrences 198 

9.7 Solving a nonlinear recurrence 200 

9.8 Discussion 203 

9.9 Exercises 204 

10 Probability 207 

10.1 An Introduction to Probability 208 

10.2 Conditional Probability and Independent Events 210 

10.3 Bernoulli Trials 211 

10.4 Discrete Random Variables 212 

10.5 Central Tendency 214 

10.6 Probability Spaces with Infinitely Many Outcomes 219 

10.7 Discussion 220 

10.8 Exercises 220 


xix 



Contents 


11 Applying Probability to Combinatorics 223 

11.1 A First Taste of Ramsey Theory 223 

11.2 Small Ramsey Numbers 224 

11.3 Estimating Ramsey Numbers 225 

11.4 Applying Probability to Ramsey Theory 226 

11.5 Ramsey's Theorem 227 

11.6 The Probabilistic Method 228 

11.7 Discussion 229 

11.8 Exercises 230 

12 Graph Algorithms 233 

12.1 Minimum Weight Spanning Trees 233 

12.2 Digraphs 239 

12.3 Dijkstra's Algorithm for Shortest Paths 239 

12.4 Plistorical Notes 247 

12.5 Exercises 247 

13 Network Flows 253 

13.1 Basic Notation and Terminology 253 

13.2 Flows and Cuts 255 

13.3 Augmenting Paths 257 

13.4 The Ford-Fulkerson Labeling Algorithm 261 

13.5 A Concrete Example 264 

13.6 Integer Solutions of Linear Programming Problems 267 

13.7 Exercises 268 

14 Combinatorial Applications of Network Flows 273 

14.1 Introduction 273 

14.2 Matchings in Bipartite Graphs 274 

14.3 Chain partitioning 278 

14.4 Exercises 282 

15 Polya’s Enumeration Theorem 287 

15.1 Coloring the Vertices of a Square 288 

15.2 Permutation Groups 290 

15.3 Burnside's Lemma 293 

15.4 Polya's Theorem 295 

15.5 Applications of Polya's Enumeration Formula 299 

15.6 Exercises 305 


xx 



Contents 


16 The Many Faces of Combinatorics 309 

16.1 On-line algorithms 309 

16.2 Extremal Set Theory 312 

16.3 Markov Chains 314 

16.4 The Stable Matching Theorem 316 

16.5 Zero-One Matrices 317 

16.6 Arithmetic Combinatorics 319 

16.7 The Lovasz Local Lemma 320 

16.8 Applying the Local Lemma 322 

A Epilogue 325 

B Background Material for Combinatorics 327 

B.l Introduction 327 

B.2 Intersections and Unions 328 

B.3 Cartesian Products 331 

B.4 Binary Relations and Functions 331 

B.5 Finite Sets 333 

B.6 Notation from Set Theory and Logic 334 

B.7 Formal Development of Number Systems 335 

B.8 Multiplication as a Binary Operation 338 

B.9 Exponentiation 340 

B.10 Partial Orders and Total Orders 340 

B.ll A Total Order on Natural Numbers 341 

B.l 2 Notation for Natural Numbers 342 

B.13 Equivalence Relations 344 

B.14 The Integers as Equivalence Classes of Ordered Pairs 345 

B.l 5 Properties of the Integers 345 

B.l 6 Obtaining the Rationals from the Integers 348 

B.l 7 Obtaining the Reals from the Rationals 349 

B.18 Obtaining the Complex Numbers from the Reals 350 

B.l 9 The Zermelo-Fraenkel Axioms of Set Theory 352 

C List of Notation 355 

Index 357 


xxi 




Prologue 

A unique feature of this book is a recurring cast of characters: Alice, Bob, Carlos, Dave, 
Xing, Yolanda and Zori. They are undergraduate students at Georgia Tech, they're 
taking an 8:05am section of Math 3012: Applied Combinatorics, and they frequently 
go for coffee at the Clough Undergraduate Learning Center immediately after the class 
is over. They've become friends of sorts and you may find their conversations about 
Applied Combinatorics of interest, as they will may reveal subtleties behind topics 
currently being studied, reinforce connections with previously studied material or set 
the table for topics which will come later. Sometimes, these conversations will set aside 
in a clearly marked Discussion section, but they will also be sprinkled as brief remarks 
throughout the text. 

In time, you will get to know these characters and will sense that, for example, when 
Dave comments on a topic, it will represent a perspective that Zori is unlikely to share. 
Some comments are right on target while others are "out in left field." Some may even 
be humorous, at least we hope this is the case. Regardless, our goal is not to entertain — 
although that is not all that bad a side benefit. Instead, we intend that our informal 
approach adds to the instructional value of our text. 

Now it is time to meet our characters: 

Alice is a computer engineering major from Philadelphia. She is ambitious, smart 
and intense. Alice is quick to come to conclusions, most of which are right. On occa- 
sion, Alice is not kind to Bob. 

Bob is a management major from Omaha. He is a hard working and conscientious. 
Bob doesn't always keep pace with his friends, but anything he understands, he owns, 
and in the end, he gets almost everything. On the other hand. Bob has never quite 
understood why Alice is short with him at times. 

Carlos is a really, really smart physics major from San Antonio. He has three older 
brothers and two sisters, one older, one younger. His high school background wasn't 
all that great, but Carlos is clearly a special student at Georgia Tech. He absorbs new 
concepts at lightning speed and sees through to the heart of almost every topic. He 
thinks carefully before he says something and is admirably polite. 

Dave is a discrete math major from Los Angeles. Dave is a flake. He's plenty smart 
enough but not all that diligent. Still, he has unique insights into things and from time 
to time says something worth hearing — not always but sometimes. His friends say that 
Dave suffers from occasional brain-mouth disconnects. 
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Xing is a computer science major from New York. Xing's parents immigrated from 
Beijing, and he was strongly supported and encouraged in his high school studies. 
Xing is detail oriented and not afraid to work hard. 

Yolanda is a double major (computer science and chemistry) from Cumming, a small 
town just north of Atlanta. Yolanda is the first in her extended family to go to a college 
or university. She is smart and absorbs knowledge like a sponge. It's all new to her 
and her horizons are raised day by day. 

Zori is an applied math major from Detroit. She is bottom-line focused, has little time 
for puzzles and always wants to see applications to justify why something is included 
in the course. Zori is determined, driven and impatient at times. 
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CHAPTER 


An Introduction to Combinatorics 


As we hope you will sense right from the beginning, we believe that combinatorial 
mathematics is one of the most fascinating and captivating subjects on the planet. 
Combinatorics is very concrete and has a wide range of applications, but it also has 
an intellectually appealing theoretical side. Our goal is to give you a taste of both. In 
order to begin, we want to develop, through a series of examples, a feeling for what 
types of problems combinatorics addresses. 

1.1 Introduction 

There are three principal themes to our course: 

Discrete Structures Graphs, digraphs, networks, designs, posets, strings, patterns, 
distributions, coverings, and partitions. 

Enumeration Permutations, combinations, inclusion/ exclusion, generating functions, 
recurrence relations, and Polya counting. 

Algorithms and Optimization Sorting, eulerian circuits, hamiltonian cycles, planarity 
testing, graph coloring, spanning trees, shortest paths, network flows, bipartite 
matchings, and chain partitions. 

To illustrate the accessible, concrete nature of combinatorics and to motivate top- 
ics that we will study, this preliminary chapter provides a first look at combinatorial 
problems, choosing examples from enumeration, graph theory, number theory, and 
optimization. The discussion is very informal — but this should serve to explain why 
we have to be more precise at later stages. We ask lots of questions, but at this stage, 
you'll only be able to answer a few. Later, you'll be able to answer many more . . . but 
as promised earlier, most likely you'll never be able to answer them all. And if we're 
wrong in making that statement, then you're certain to become very famous. Also, 
you'll get an A++ in the course and maybe even a Ph.D. too. 
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1.2 Enumeration 

Many basic problems in combinatorics involve counting the number of distributions 
of objects into cells — where we may or may not be able to distinguish between the 
objects and the same for the cells. Also, the cells may be arranged in patterns. Here 
are concrete examples. 

Amanda has three children: Dawn, Keesha and Seth. 

1 . Amanda has ten one dollar bills and decides to give the full amount to her chil- 
dren. How many ways can she do this? For example, one way she might dis- 
tribute the funds is to give Dawn and Keesha four dollars each with Seth receiv- 
ing the balance — two dollars. Another way is to give the entire amount to Keesha, 
an option that probably won't make Dawn and Seth very happy. Note that hid- 
den within this question is the assumption that Amanda does not distinguish the 
individual dollar bills, say by carefully examining their serial numbers. Instead, 
we intend that she need only decide the amount each of the three children is to 
receive. 

2 . The amounts of money distributed to the three children form a sequence which 
if written in non-increasing order has the form: a\, a2, a$ with rt | > an > 1Z3 and 
a\ + fl2 + «3 = 10 . How many such sequences are there? 

3 . Suppose Amanda decides to give each child at least one dollar. How does this 
change the answers to the first two questions? 

4 . Now suppose that Amanda has ten books, in fact the top 10 books from the New 
York Times best-seller list, and decides to give them to her children. How many 
ways can she do this? Again, we note that there is a hidden assumption — the ten 
books are all different. 

5 . Suppose the ten books are labeled B i, B2, ■ ■ ■ , f> i o • The sets of books given to the 
three children are pairwise disjoint and their union is {B f>2, . . . , Bio}- How 
many different sets of the form {Si, S2, S3} where Si, S 2 and S3 are pairwise dis- 
joint and Si U S2 U S3 = {Bi, B2, . . . ,Bio}? 

6. Suppose Amanda decides to give each child at least one book. How does this 
change the answers to the preceding two questions? 

7 . How would we possibly answer these kinds of questions if ten was really ten 
thousand (OK, we're not talking about children any more!) and three was three 
thousand? Could you write the answer on a single page in a book? 
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1.3 Combinatorics and Graph Theory 


A circular necklace with a total of six beads will be assembled using beads of three 
different colors. In Figure 1.1, we show four such necklaces — however, note that the 
first three are actually the same necklace. Each has three red beads, two blues and one 
green. On the other hand, the fourth necklace has the same number of beads of each 
color but it is a different necklace. 





Figure 1.1: Necklaces made with three colors 



1. How many different necklaces of six beads can be formed using three reds, two 
blues and one green? 

2. How many different necklaces of six beads can be formed using red, blue and 
green beads (not all colors have to be used)? 

3. How many different necklaces of six beads can be formed using red, blue and 
green beads if all three colors have to be used? 

4. How would we possibly answer these questions for necklaces of six thousand 
beads made with beads from three thousand different colors? What special soft- 
ware would be required to find the exact answer and how long would the com- 
putation take? 

1.3 Combinatorics and Graph Theory 

A graph G consists of a vertex set V and a collection E of 2-element subsets of V. Ele- 
ments of E are called edges. In our course, we will (almost always) use the convention 
that V = {1,2, 3 , ,n} for some positive integer n. With this convention, graphs can 
be described precisely with a text file: 

1. The first line of the file contains a single integer n, the number of vertices in the 
graph. 

2. Each of the remaining lines of the file contains a pair of distinct integers and 
specifies an edge of the graph. 
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We illustrate this convention in Figure 1.2 with a text file and the diagram for the 
graph G it defines. 

graphl . txt 
9 

6 2 
1 5 
1 7 
6 8 
9 1 

4 3 

5 7 
1 3 
5 9 
7 9 

Figure 1.2: A graph defined by data 

Much of the notation and terminology for graphs is quite natural. See if you can 
make sense out of the following statements which apply to the graph G defined above: 

1. G has 9 vertices and 10 edges. 

2. {2,6} is an edge. 

3. Vertices 5 and 9 are adjacent. 

4. {5,4} is not an edge. 

5. Vertices 3 and 7 are not adjacent. 

6. P = (4, 3, 1, 7, 9, 5) is a path of length 5 from vertex 4 to vertex 5. 

7. C = (5, 9, 7, 1) is cycle of length 4. 

8. G is disconnected and has two components. One of the components has vertex 
set {2,6,8}. 

9. {1,5,7} is a triangle. 

10. {1,7, 5, 9} is a clique of size 4. 

11. {4, 2, 8, 5} is an independent set of size 4. 
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1.3 Combinatorics and Graph Theory 


Equipped only with this little bit of background material, we are already able to pose 
a number of interesting and challenging problems. 

Example 1.3. Consider the graph G shown in Figure 1.4. 



Figure 1.4: A connected graph 


1. What is the largest k for which G has a path of length k? 

2. What is the largest k for which G has a cycle of length k? 

3. What is the largest k for which G has a clique of size /c? 

4. What is the largest k for which G has an independent set of size k? 

5. What is the shortest path from vertex 7 to vertex 6? 

Suppose we gave the class a text data file for a graph on 1500 vertices and asked 
whether the graph contains a cycle of length at least 500. Raoul says yes and Carla says 
no. How do we decide who is right? 

Suppose instead we asked whether the graph has a clique of size 500. Helene says 
that she doesn't think so, but isn't certain. Is it reasonable that her classmates insist 
that she make up her mind, one way or the other? Is determining whether this graph 
has a clique of size 500 harder, easier or more or less the same as determining whether 
it has a cycle of size 500. 

We will frequently study problems in which graphs arise in a very natural manner. 
Here's an example. 


7 


Chapter 1 An Introduction to Combinatorics 


Example 1.5. In Figure 1.6, we show the location of some radio stations in the plane, 
together with a scale indicating a distance of 200 miles. Radio stations that are closer 
than 200 miles apart must broadcast on different frequencies to avoid interference. 



200 miles 


Figure 1.6: Radio Stations 


We've shown that 6 different frequencies are enough. Can you do better? 

Can you find 4 stations each of which is within 200 miles of the other 3? Can you 
find 8 stations each of is more than 200 miles away from the other 7? Is there a natural 
way to define a graph associated with this problem? 

Example 1.7. How big must an applied combinatorics class be so that there are either 
(a) six students with each pair having taken at least one other class together, or (b) six 
students with each pair together in a class for the first time. Is this really a hard problem 
or can we figure it out in just a few minutes, scribbling on a napkin? 

1.4 Combinatorics and Number Theory 

Broadly, number theory concerns itself with the properties of the positive integers. 
G.H. Hardy was a brilliant British mathematician who lived through both World Wars 
and conducted a large deal of number-theoretic research. He was also a pacifist who 
was happy that, from his perspective, his research was not "useful". He wrote in his 
1940 essay A Mathematician's Apology "[n]o one has yet discovered any warlike purpose 
to be served by the theory of numbers or relativity, and it seems very unlikely that 
anyone will do so for many years." 1 Little did he know, the purest mathematical ideas 

1 G.H. Hardy, A Mathematician's Apology, Cambridge University Press, p. 140. (1993 printing) 
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of number theory would soon become indispensable for the cryptographic techniques 
that kept communications secure. Our subject here is not number theory, but we will 
see a few times where combinatorial techniques are of use in number theory 

Example 1.8. Form a sequence of positive integers using the following rules. Start with 
a positive integer n > 1. If n is odd, then the next number is 3« + 1. If n is even, then 
the next number is n /2. Halt if you ever reach 1. For example, if we start with 28, the 
sequence is 


28, 14, 7, 22, 11, 34, 17, 52, 26, 13, 40, 20, 10, 5, 16, 8, 4, 2, 1 . 

Now suppose you start with 19. Then the first few terms are 

19,58,29,88,44,22. 

But now we note that the integer 22 appears in the first sequence, so the two sequences 
will agree from this point on. Sequences formed by this rule are called Collatz se- 
quences. 

Pick a number somewhere between 100 and 200 and write down the sequence you 
get. Regardless of your choice, you will eventually halt with a 1. However, is there 
some positive integer n (possibly quite large) so that if you start from n, you will never 
reach 1? 

Example 1.9. Students in middle school are taught to add fractions by finding least 
common multiples. For example, the least common multiple of 15 and 12 is 60, so: 

2 7 _ 8 35 _ 43 

15 + 12“60 + 60“60' 

How hard is it to find the least common multiple of two integers? 

It's really easy if you can factor them into primes. For example, consider the problem 
of finding the least common multiple of 351785000 and 316752027900 if you just happen 
to know that 


351785000 = 2 3 X 5 4 X 7 x 19 X 23 2 and 
316752027900 = 2 2 x 3 x 5 2 x 7 3 x 11 x 23 4 . 

Then the least common multiple is 

300914426505000 = 2 3 x 3 x 5 4 x 7 3 x 11 x 19 x 23 4 . 

So to find the least common multiple of two numbers, we just have to factor them 
into primes. That doesn't sound too hard. For starters, can you factor 1961? OK, how 
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about 1348433? Now for a real challenge. Suppose you are told that the integer 

c = 5568490117077035708244283173335040521716369235589951150965 
2043138898236817075547572153799 

is the product of two primes a and b . Can you find them? 

What if factoring is hard? Can you find the least common multiple of two relatively 
large integers, say each with about 500 digits, by another method? How should middle 
school students be taught to add fractions? 

As an aside, we note that most calculators can't add or multiply two 20 digits num- 
bers, much less two numbers with more than 500 digits. But it is relatively straight- 
forward to write a computer program that will do the job for us. Also, there are some 
powerful mathematical software tools available. Two very well known commercial ex- 
amples are Maple® and Mathematica®. In this text, we will from time to time, make 
use of the open source computer algebra system SageMath. We will sometimes embed 
interactive SageMath cells in the text, but you can also use SageMath for free online 
via the SageMath Cloud. For example, the SageMath cell below will produce the fac- 
torization shown above. 

factor (30091 4426505000) 


2 A 3 * 3 * 5 A 4 * 7 A 3 * 11 * 19 * 23 A 4 

If you're reading this text in a web browser, go ahead and change the integer in the 
SageMath cell above to some other, perhaps larger, integer and click the button again 
to get the prime factorization of your new integer. 

Now here's how we made up the challenge problem. First, we found a site on the 
web that lists large primes and found these two values: 

a = 2425967623052370772757633156976982469681 and 
b = 22953686867719691230002707821868552601124472329079. 

The SageMath code below calculates a xb, and returns the result instantly. 

a = 2425967623052370772757633156976982469681 

b = 22953686867719691230002707821868552601124472329079 

a*b 

On the other hand, if you ask SageMath to factor c, as in the cell below, you'll likely 
be waiting a long time. If you get a response in more than a couple of minutes, please 
email us so that we can update the text with larger primes a and b\ 

factor (55684901 170770357082442831 73335040521 71 63692\ 
355899511509652043138898236817075547572153799) 
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1.5 Combinatorics and Geometry 


Questions arising in number theory can also have an enumerative flair, as the fol- 
lowing example shows. 


Example 1.10. In Table 1.11, we show the integer partitions of 8. 


8 distinct parts 
6 + 1+1 

5+1+1+1 odd parts 

4+2+2 

3+3+2 

3+2+1+1+1 

2 + 2 + 2 + 1+1 


7+1 distinct parts, odd parts 
5+3 distinct parts, odd parts 
4+4 

4+2+1+1 

3+3+1+1 odd parts 
3+1+1+1+1+1 odd parts 
2 + 2 + 1 + 1 + 1+1 

l+l+l+l+l+l+l+l odd parts 


6+2 distinct parts 

5+2+1 distinct parts 

4+3+1 distinct parts 

4+1+1+1+1 

3+2+2+1 

2 + 2 + 2+2 

2 + 1 + 1 + 1 + 1 + 1+1 


Table 1.11: The partitions of 8, noting those into distinct parts and those into odd 

PARTS. 


There are 22 partitions altogether, and as noted, exactly 6 of them are partitions of 8 
into odd parts. Also, exactly 6 of them are partitions of 8 into distinct parts. 

What would be your reaction if we asked you to find the number of integer partitions 
of 25892? Do you think that the number of partitions of 25892 into odd parts equals the 
number of partitions of 25892 into distinct parts? Is there a way to answer this question 
without actually calculating the number of partitions of each type? 


1.5 Combinatorics and Geometry 


There are many problems in geometry that are innately combinatorial or for which 
combinatorial techniques shed light on the problem. 


Example 1.12. In Figure 1.13, we show a family of 4 lines in the plane. Each pair of 
lines intersects and no point in the plane belongs to more than two lines. These lines 
determine 11 regions. 
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Under these same restrictions, how many regions would a family of 8947 lines de- 
termine? Can different arrangements of lines determine different numbers of regions? 

Example 1.14. Mandy says she has found a set of 882 points in the plane that determine 
exactly 752 lines. Tobias disputes her claim. Who is right? 

Example 1.15. There are many different ways to draw a graph in the plane. Some 
drawings may have crossing edges while others don't. But sometimes, crossing edges 
must appear in any drawing. Consider the graph G shown in Figure 1.16. 



Can you redraw G without crossing edges? 

Suppose Sam and Deborah were given a homework problem asking whether a par- 
ticular graph on 2843952 vertices and 9748032 edges could be drawn without edge 
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crossings. Deborah just looked at the number of vertices and the number of edges and 
said that the answer is "no." Sam questions how she can be so certain — without look- 
ing more closely at the structure of the graph. Is there a way for Deborah to justify her 
definitive response? 

1.6 Combinatorics and Optimization 

You likely have already been introduced to optimization problems, as calculus students 
around the world are familiar with the plight of farmers trying to fence the largest 
area of land given a certain amount of fence or people needing to cross rivers down- 
stream from their current location who must decide where they should cross based 
on the speed at which they can run and swim. However, these problems are inher- 
ently continuous. In theory, you can cross the river at any point you want, even if it 
were irrational. (OK, so not exactly irrational, but a good decimal approximation.) In 
this course, we will examine a few optimization problems that are not continuous, as 
only integer values for the variables will make sense. It turns out that many of these 
problems are very hard to solve in general. 

Example 1.17. In Figure 1.18, we use letters for the labels on the vertices to help dis- 
tinguish visually from the integer weights on the edges. 



Figure 1.18: A labeled graph with weighted edges 

Suppose the vertices are cities, the edges are highways and the weights on the edges 
represent distance. 
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1. What is the shortest path from vertex £ to vertex B? 

2. Suppose Ariel is a salesperson whose home base is city A. In what order should 
Ariel visit the other cities so that she goes through each of them at least once 
and returns home at the end — while keeping the total distance traveled to a min- 
imum? Can Ariel accomplish such a tour visiting each city exactly once? 

3. Sanjay is a highway inspection engineer and must traverse every highway each 
month. Sanjay's homebase is City E. In what order should Sanjay traverse the 
highways to minimize the total distance traveled? Can Sanjay make such a tour 
traveling along each highway exactly once? 

Example 1.19. Now suppose that the vertices are locations of branch banks in Atlanta 
and that the weights on an edge represents the cost, in millions of dollars, of building 
a high capacity data link between the branch banks at it two end points. In this model, 
if there is no edge between two branch banks, it means that the cost of building a data 
link between this particular pair is prohibitively high (here we might be tempted to say 
the cost is infinite, but the authors don't admit to knowing the meaning of this word). 

Our challenge is to decide which data links should be constructed to form a network 
in which any branch bank can communicate with any other branch. We assume that 
data can flow in either direction on a link, should it be built, and that data can be 
relayed through any number of data links. So to allow full communication, we should 
construct a spanning tree in this network. In Figure 1.20, we show a graph G on the 
left and one of its many spanning trees on the right. 



Figure 1.20: A weighted graph and spanning tree 
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The weight of the spanning tree is the sum of the weights on the edges. In our model, 
this represents the costs, again in millions of dollars, of building the data links associ- 
ated with the edges in the spanning tree. For the spanning tree shown in Figure 1.20, 
this total is 


12 + 25 + 19 + 18 + 23 + 19 = 116. 

Of all spanning trees, the bank would naturally like to find one having minimum 
weight. 

How many spanning trees does this graph have? For a large graph, say one with 
2875 vertices, does it make sense to find all spanning trees and simply take the one 
with minimum cost? In particular, for a positive integer n, how many trees have vertex 
set {1,2,3, . . . ,n}7 


1.7 Sudoku Puzzles 

Here's an example which has more substance than you might think at first glance. It 
involves Sudoku puzzles, which have become immensely popular in recent years. 

Example 1.21. A Sudoku puzzle is a 9 X 9 array of cells that when completed have 
the integers 1, 2, . . . , 9 appearing exactly once in each row and each column. Also (and 
this is what makes the puzzles so fascinating), the numbers 1, 2, 3, . . . , 9 appear once in 
each of the nine 3x3 subsquares identified by the darkened borders. To be considered 
a legitimate Sudoku puzzle, there should be a unique solution. In Figure 1.22, we show 
two Sudoku puzzles. The one on the right is fairly easy, and the one on the left is far 
more challenging. 

There are many sources of Sudoku puzzles, and software that generates Sudoku 
puzzles and then allows you to play them with an attractive GUI is available for all 
operating systems we know anything about (although not recommend to play them 
during class!). Also, you can find Sudoku puzzles on the web at: http : //www . websudoku . 
com. On this site, the "Evil" ones are just that. 

How does Rory make up good Sudoku puzzles, ones that are difficult for Mandy to 
solve? How could Mandy use a computer to solve puzzles that Rory has constructed? 
What makes some Sudoku puzzles easy and some of them hard? 

The size of a Sudoku puzzle can be expanded in an obvious way, and many newspa- 
pers include a 16 X 16 Sudoku puzzle in their Sunday edition (just next to a challenging 
crosswords puzzle). How difficult would it be to solve a 1024 x 1024 Sudoku puzzle, 
even if you had access to a powerful computer? 
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Figure 1 . 22 : Sudoku puzzles 


1.8 Discussion 

Over coffee after their first combinatorics class, Xing remarked "This doesn't seem to 
be going like calculus. I'm expecting the professor to teach us how to solve problems — 
at least some kinds of problems. Instead, a whole bunch of problems were posed and 
we were asked whether we could solve them." 

Yolanda jumped in, saying "You may be judging things too quickly. I'm fascinated 
by these kinds of questions. They're different." 

Zori grumpily laid bare her concerns: "After getting out of Georgia Tech, who's go- 
ing to pay me to count necklaces, distribute library books or solve Sudoku puzzles?" 

Bob politely countered, "But the problems on networks and graphs seemed to have 
practical applications. I heard my uncle, a very successful business guy, talk about 
franchising problems that sound just like those." 

Alice speculated, "All those network problems sound the same to me. A fair to mid- 
dling computer science major could probably write programs to solve any of them." 

Dave mumbled, "Maybe not. Similar sounding problems might actually be quite 
different in the end. Maybe we'll learn to tell the difference." 

After a bit of quiet time interrupted only by lattes disappearing, Carlos said softly, 
"It might not be so easy to distinguish hard problems from easy ones." 

Alice followed, "Regardless, what strikes me is that we all, well almost all of us," 
she said, rolling her eyes at Bob, "seem to understand everything talked about in class 
today. It was so very concrete. I liked that." 
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CHAPTER 


Strings, Sets, and Binomial 

Coefficients 

Much of combinatorial mathematics can be reduced to the study of strings, as they 
form the basis of all written human communications. Also, strings are the way humans 
communicate with computers, as well as the way one computer communicates with 
another. As we shall see, sets and binomial coefficients are topics that fall under the 
string umbrella. So it makes sense to begin our in-depth study of combinatorics with 
strings. 


2.1 Strings: A First Look 

Let n be a positive integer. Throughout this text, we will use the shorthand notation [n] 
to denote the n -element set {1,2 , ... ,n}. Now let X be a set. Then a function s : [n \ —> 
X is also called an X-string of length n . In discussions of X-strings, it is customary to 
refer to the elements of X as characters, while the element s(z) is the z’ th character of s. 
Whenever practical, we prefer to denote a string s by writing s =“x\ X 2 X 3 . . . x n " , rather 
than the more cumbersome notation s(l) = x\, s(2) = xj_, ..., s ( n ) = x„ . 

There are a number of alternatives for the notation and terminology associated with 
strings. First, the characters in a string s are frequently written using subscripts as 
Si, S 2 , . . . , s n , so the z th -term of s can be denoted s, rather than s (z). Strings are also 
called sequences, especially when X is a set of numbers and the function s is defined 
by an algebraic rule. For example, the sequence of odd integers is defined by s; = 2z — 1. 

Alternatively, strings are called words, the set X is called the alphabet and the ele- 
ments of X are called letters. For example, aababbccabcbb is a 13-letter word on the 
3-letter alphabet {a, b, c}. 

In many computing languages, strings are called arrays. Also, when the character 
s (z) is constrained to belong to a subset X, c X, a string can be considered as an element 
of the cartesian product X\ X X 2 X • • • X X„, which is normally viewed as zz -tuples of 
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the form (xi, X 2 , . . . , x n ) such that x, e X,- for all i e [n]. 

Example 2.1. In the state of Georgia, license plates consist of four digits followed by a 
space followed by three capital letters. The first digit cannot be a 0. How many license 
plates are possible? 

Solution. Let X consist of the digits {0, 1,2,..., 9}, let Y be the singleton set whose 
only element is a space, and let Z denote the set of capital letters. A valid license plate 
is just a string from 

(X - {0}) xXxXxXxYxZxZxZ 

so the number of different license plates is 9 X 10 3 x 1 X 26 3 = 158 184000, since the 
size of a product of sets is the product of the sets' sizes. We can get a feel for why this 
is the case by focusing just on the digit part of the string here. We can think about the 
digits portion as being four blanks that need to be filled. The first blank has 9 options 
(the digits 1 through 9). If we focus on just the digit strings beginning with 1, one 
perspective is that they range from 1000 to 1999, so there are 1000 of them. However, 
we could also think about there being 10 options for the second spot, 10 options for the 
third spot, and 10 options for the fourth. Multiplying 10 x 10 x 10 gives 1000. Since our 
analysis of filling the remaining digit blanks didn't depend on our choice of a 1 for the 
first position, we see that each of the 9 choices of initial digit gives 1 000 strings, for a 
total of 9 000 = 9 x 10 3 . 

In the case that X = {0, 1}, an X-string is called a 0-1 string (also a binary string or 
bit string.). When X = {0, 1, 2}, an X-string is also called a ternary string. 

Example 2.2. A machine instruction in a 32-bit operating system is just a bit string of 
length 32. Thus, there are 2 options for each of 32 positions to fill, making the number 
of such strings 2 32 = 4294967 296. In general, the number of bit strings of length n is 
2 ". 

Example 2.3. Suppose that a website allows its users to pick their own usernames for 
accounts, but imposes some restrictions. The first character must be an upper-case 
letter in the English alphabet. The second through sixth characters can be letters (both 
upper-case and lower-case allowed) in the English alphabet or decimal digits (0-9). The 
seventh position must be or The eighth through twelfth positions allow lower- 
case English letters, '%', and '#'. The thirteenth position must be a digit. How many 
users can the website accept registrations from? 

Solution. We can visualize the options by thinking of the 13 positions in the string as 
blanks that need to be filled in and putting the options for that blank above. In Table 2.4, 
we've used U to denote the set of upper-case letters, L for the set of lower-case letters, 
and D for the set of digits. 
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29 

29 

29 
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Table 2.4: String Template 

Below each position in the string, we've written the number of options for that po- 
sition. (For example, there are 62 options for the second position, since there are 52 
letters once both cases are accounted for and 10 digits. We then multiply these possi- 
bilities together, since each choice is independent of the others. Therefore, we have 

26 x 62 5 x 2 x 29 5 x 10 = 9 771 287 250 890 863 360 
total possible usernames. 

2.2 Permutations 

In the previous section, we considered strings in which repetition of symbols is al- 
lowed. For instance, "01110000" is a perfectly good bit string of length eight. FIow- 
ever, in many applied settings where a string is an appropriate model, a symbol may 
be used in at most one position. 

Example 2.5. Imagine placing the 26 letters of the English alphabet in a bag and draw- 
ing them out one at a time (without returning a letter once it's been drawn) to form 
a six-character string. We know there are 26 6 strings of length six that can be formed 
from the English alphabet. Flowever, if we restrict the manner of string formation, not 
all strings are possible. The string "yellow" has six characters, but it uses the letter "1" 
twice and thus cannot be formed by drawing letters from a bag. Flowever, "jacket" 
can be formed in this manner. Starting from a full bag, we note there are 26 choices 
for the first letter. Once it has been removed, there are 25 letters remaining in the bag. 
After drawing the second letter, there are 24 letters remaining. Continuing, we note 
that immediately before the sixth letter is drawn from the bag, there are 21 letters in 
the bag. Thus, we can form 26 • 25 • 24 • 23 • 22 • 21 six-character strings of English letters 
by drawing letters from a bag, a little more than half the total number of six-character 
strings on this alphabet. 

To generalize the preceding example, we now introduce permutations. To do so, let 
X be a finite set and let n be a positive integer. An X-string s = X\X 2 . . . x n is called 
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a permutation if all n characters used in s are distinct. Clearly, the existence of an 
X-permutation of length n requires that |X| > n. 

When n is a positive integer, we define n ! (read "n factorial" ) by 

n\ = n -{n - 1) ■ (n -2) 3-2 - 1. 

By convention, we set 0! = 1. As an example, 7! = 7- 6- 5- 4- 3- 2- l = 5040. Now for 
integers m, n with m > n > 0 define P{m, n) by 

m\ 

P(m, n) = = m(m - 1) • • • (m - n +1). 

( m - «)! 


For example, P( 9, 3) = 9 ■ 8 ■ 7 = 504 and P( 8, 4) = 8 ■ 7 ■ 6 ■ 5 = 1680. Also, a computer 
algebra system will quickly report that 

P( 68,23) = 20732231223375515741894286164203929600000. 


Proposition 2.6. If X is an m-element set and n is a positive integer with m > n, then the 
number ofX-strings of length n that are permutations is P(m,n). 


Proof. The proposition is true since when constructing a permutation s = X\ Xj, . . . x n 
from an m -element set, we see that there are m choices for X\ . After fixing X\, we have 
that for % 2 , there are m — 1 choices, as we can use any element of X - {xi}. For X3, 
there are m — 2 choices, since we can use any element in X - {x\ , x'2}. For x n , there are 
m - n + 1 choices, because we can use any element of X except x\, X2, ■ ■ ■ x„_i. Noting 


that 


P{m, n) 


^—7 = m(m - 1 ){m - 2) . . . (m - n + 1), 

(m — n)\ 


our proof is complete. 


□ 


Note that the answer we arrived at in Example 2.5 is simply P( 26, 20) as we would 
expect in light of Proposition 2.6. 

Example 2.7. It's time to elect a slate of four class officers (President, Vice President, 
Secretary and Treasurer) from the pool of 80 students enrolled in Applied Combina- 
torics. If any interested student could be elected to any position (Alice contends this is 
a big "if" since Bob is running), how many different slates of officers can be elected? 

Solution. To count possible officer slates, work from a set X containing the names of 
the 80 interested students (yes, even poor Bob). A permutation of length four chosen 
from X is then a slate of officers by considering the first name in the permutation as the 
President, the second as the Vice President, the third as the Secretary, and the fourth 
as the Treasurer. Thus, the number of officer slates is P(80,4) = 37957920. 
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Example 2.8. Let's return to the license plate question of Example 2.1. Suppose that 
Georgia required that the three letters be distinct from each other. Then, instead of 
having 26 3 = 17 576 ways to fill the last three positions on the license plate, we'd have 
P( 26, 3) = 26 x 25 x 24 = 15 600 options, giving a total of 140 400 000 license plates. 

As another example, suppose that repetition of letters were allowed but the three 
digits in positions two through four must all be distinct from each other (but could 
repeat the first digit, which must still be nonzero). Then there are still 9 options for 
the first position and 26 3 options for the letters, but the three remaining digits can 
be completed in P(10, 3) ways. The total number of license plates would then be 9 x 
P(10,3) X 26 3 . If we want to prohibit repetition of the digit in the first position as 
well, we need a bit more thought. We first have 9 choices for that initial digit. Then, 
when filling in the next three positions with digits, we need a permutation of length 
3 chosen from the remaining 9 digits. Thus, there are 9 x P( 9, 3) ways to complete the 
digits portion, giving a total of 9 X P( 9, 3) X 26 3 license plates. 


2.3 Combinations 

To motivate the topic of this section, we consider another variant on the officer elec- 
tion problem from Example 2.7. Suppose that instead of electing students to specific 
offices, the class is to elect an executive council of four students from the pool of 80 
students. Each position on the executive council is equal, so there would be no differ- 
ence between Alice winning the "first" seat on the executive council and her winning 
the "fourth" seat. In other words, we just want to pick four of the 80 students without 
any regard to order. We'll return to this question after introducing our next concept. 

Let X be a finite set and let A be an integer with 0 < k < |X|. Then a A: -element subset 
of X is also called a combination of size k. When |X| = n, the number of A: -element 
subsets of X is denoted (”). Numbers of the form (" ( ) are called binomial coefficients, 
and many combinatorists read (jj) as "n choose A." When we need an in-line version, 
the preferred notation is C(n , k ) . Also, the quantity C(n , k) is referred to as the number 
of combinations of n things, taken A at a time. 

Bob notes that with this notation, the number of ways a four-member executive coun- 
cil can be elected from the 80 interested students is C(80,4). However, he's puzzled 
about how to compute the value of C(80, 4). Alice points out that it must be less than 
P(80,4), since each executive council could be turned into 4! different slates of officers. 
Carlos agrees and says that Alice has really hit upon the key idea in finding a formula 
to compute C(n, A) in general. 
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Proposition 2.9. If n and k are integers with 0 < k < n, then 


= C(n,k ) = 


P(n,k ) 
k\ 


n\ 

k\(n - k)\ 


Proof. If X is an n-element set, then P(n,k ) counts the number of X-permutations of 
length A:. Each of the C(n , k) A: -element subsets of X can be turned into k\ permutations, 
and this accounts for each permutation exactly once. Therefore, A!C(n, k) = P(n , k) and 
dividing by k\ gives the formula for the number of A-element subsets. □ 

Using Proposition 2.9, we can now determine that C(80,4) = 1581580 is the num- 
ber of ways a four-member executive council could be elected from the 80 interested 
students. 

Our argument above illustrates a common combinatorial counting strategy. We 
counted one thing and determined that the objects we wanted to count were over- 
counted the same number of times each, so we divided by that number (A! in this case). 

The following result is tantamount to saying that choosing elements to belong to 
a set (the executive council election winners) is the same as choosing those elements 
which are to be denied membership (the election losers). 

Proposition 2.10. For all integers n and k with 0 < k < n, 



n 

n-k 


Example 2.11. A Southern restaurant lists 21 items in the "vegetable" category of its 
menu. (Like any good Southern restaurant, macaroni and cheese is one of the vegetable 
options.) They sell a vegetable plate which gives the customer four different vegetables 
from the menu. Since there is no importance to the order the vegetables are placed on 
the plate, there are C(21,4) = 5985 different ways for a customer to order a vegetable 
plate at the restaurant. 

Our next example introduces an important correspondence between sets and bit 
strings that we will repeatedly exploit in this text. 

Example 2.12. Let n be a positive integer and let X be an n-element set. Then there is 
a natural one-to-one correspondence between subsets of X and bit strings of length n . 
To be precise, let X = {xj , xi, . . . , x„}. Then a subset AcX corresponds to the string 
s where s(z) = 1 if and only if i e A. For example, if X = {a,b,c,d,e, f, g, h}, then 
the subset {b,c, g} corresponds to the bit string 01100010. There are C(8,3) = 56 bit 
strings of length eight with precisely three l's. Thinking about this correspondence, 
what is the total number of subsets of an n-element set? 
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2.4 Combinatorial Proofs 


Combinatorial arguments are among the most beautiful in all of mathematics. Often- 
times, statements that can be proved by other, more complicated methods (usually 
involving large amounts of tedious algebraic manipulations) have very short proofs 
once you can make a connection to counting. In this section, we introduce a new way 
of thinking about combinatorial problems with several examples. Our goal is to help 
you develop a "gut feeling" for combinatorial problems. 

Example 2.13. Let n be a positive integer. Use Figure 2.14 to explain why 


1 +2 + 3 + ■ ■ ■ + n 


n(n + 1) 
2 



Figure 2.14: The sum of the first n integers 


Solution. Consider an ( n +1 )x(n +1) array of dots as depicted in Figure 2.14. There are 
(n +1) 2 dots altogether, with exactly n +1 on the main diagonal. The off-diagonal entries 
split naturally into two equal size parts, those above and those below the diagonal. 

Furthermore, each of those two parts has S ( n ) = 1+2 + 3 + •■■+« dots. It follows 
that 

, (n + l) 2 - (n + 1) 

and this is obvious! Now a little algebra on the right hand side of this expression 
produces the formula given earlier. 
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Example 2.15. Let n be a positive integer. Explain why 

l+3 + 5 + -- -+2n-l = « 2 . 



Figure 2.16: The sum of the first n odd integers 


Solution. The left hand side is just the sum of the first n odd integers. But as sug- 
gested in Figure 2.16, this is clearly equal to n 2 . 

Example 2.17. Let n be a positive integer. Explain why 



Solution. Both sides count the number of bit strings of length n, with the left side 
first grouping them according to the number of 0's. 

Example 2.18. Let n and k be integers with 0 < k < n. Explain why 


n 

k + 1 



n — 1 
k 


Solution. To prove this formula, we simply observe that both sides count the number 
of bit strings of length n that contain k + 1 l's with the right hand side first partitioning 
them according to the last occurence of a 1 . (For example, if the last 1 occurs in position 
k + 5, then the remaining A: l's must appear in the preceding k + 4 positions, giving 
C(k + 4, k) strings of this type.) Note that when k = 1 (so k + 1 = 2), we have the same 
formula as developed earlier for the sum of the first n positive integers. 
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Example 2.19. Explain the identity 



Solution. Both sides count the number of {0, 1, 2}-strings of length n, the right hand 
side first partitioning them according to positions in the string which are not 2. (For 
instance, if 6 of the positions are not 2, we must first choose those 6 positions in C(n , 6) 
ways and then there are 2 6 ways to fill in those six positions by choosing either a 0 or 
a 1 for each position.) 

Example 2.20. Explain why, for each non-negative integer n, 



Solution. Both sides count the number of bit strings of length 2 n with half the bits 
being 0's, with the right side first partitioning them according to the number of l's 
occurring in the first n positions of the string. Note that we are also using the trivial 
identity (£) = („-*)■ 

2.5 The Ubiquitous Nature of Binomial Coefficients 

In this section, we present several combinatorial problems that can be solved by ap- 
peal to binomial coefficients, even though at first glance, they do not appear to have 
anything to do with sets. 

Example 2.21. The office assistant is distributing supplies. In how many ways can he 
distribute 18 identical folders among four office employees: Audrey, Bart, Cecilia and 
Darren, with the additional restriction that each will receive at least one folder? 

Imagine the folders placed in a row. Then there are 17 gaps between them. Of these 
gaps, choose three and place a divider in each. Then this choice divides the folders 
into four non-empty sets. The first goes to Audrey, the second to Bart, etc. Thus the 
answer is C(17, 3). In Figure 2.22, we illustrate this scheme with Audrey receiving 6 
folders, Bart getting 1, Cecilia 4 and Darren 7. 


■ ■■■■■ 


□ □ □ □ □ □ □□□□□□ 


Figure 2.22: Distributing Identical Objects into Distinct Cells 
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Example 2.23. Suppose we redo the preceding problem but drop the restriction that 
each of the four employees gets at least one folder. Now how many ways can the dis- 
tribution be made? 

Solution. The solution involves a "trick" of sorts. First, we convert the problem to 
one that we already know how to solve. This is accomplished by artificially inflating 
everyone's allocation by one. In other words, if Bart will get 7 folders, we say that he 
will get 8 . Also, artificially inflate the number of folders by 4, one for each of the four 
persons. So now imagine a row of 22 = 18+4 folders. Again, choose 3 gaps. This 
determines a non-zero allocation for each person. The actual allocation is one less — 
and may be zero. So the answer is C(21, 3). 

Example 2.24. Again we have the same problem as before, but now we want to count 
the number of distributions where only Audrey and Cecilia are guaranteed to get a 
folder. Bart and Darren are allowed to get zero folders. Now the trick is to artificially 
inflate Bart and Darren's allocation, but leave the numbers for Audrey and Cecilia as 
is. So the answer is C(19, 3). 

Example 2.25. Here is a reformulation of the preceding discussion expressed in terms 
of integer solutions of inequalities. 

We count the number of integer solutions to the inequality 

Xi + X 2 + X 3 + X\ + X 5 + X(, < 538 

subject to various sets of restrictions on the values of Xi,X 2 , ■ ■ ■ , + 6 - Some of these 
restrictions will require that the inequality actually be an equation. 

The number of integer solutions is: 

1. C(537, 5), when all Xi > 0 and equality holds; 

2. C(543, 5), when all x; > 0 and equality holds; 

3. C(291, 3), when X\,X 2 , X 4 , *6 > 0, x 3 = 52, X 5 = 194, and equality holds; 

4. C(537, 6 ), when all x, > 0 and the inequality is strict (Imagine a new variable X 7 
which is the balance. Note that X 7 must be positive.); 

5. C(543, 6 ), when all x, > 0 and the inequality is strict (Add a new variable X 7 as 
above. Now it is the only one which is required to be positive.); and 

6 . C(544, 6 ), when all x; > 0. 

A classical enumeration problem (with connections to several problems) involves 
counting lattice paths. A lattice path in the plane is a sequence of ordered pairs of 
integers: 

(m 1 , Mi), (m 2 , n 2 ), (m 3 , n 3 ), ( m t/ n t ) 
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so that for all i = 1,2, . . . , t — 1, either 

1. mi+i = mi + 1 and m + 1 = n,-, or 

2. m 1+ i = irij and n;+i = n,- + 1. 

In Figure 2.26, we show a lattice path from (0, 0) to (13, 8). 

(13,8) 



Figure 2.26: A Lattice Path 


Example 2.27. The number of lattice paths from ( m,n ) to (p, q) is C((p-m) + (q-n),p- 
m). 

To see why this formula is valid, note that a lattice path is just an X-string with 
X = {H,V}, where H stands for horizontal and V stands for vertical. In this case, there 
are exactly (p - m) + (q - n) moves, of which p — m are horizontal. 

Example 2.28. Let n be a non-negative integer. Then the number of lattice paths from 
(0, 0) to ( n , n ) which never go above the diagonal line y = x is the Catalan number 


C(n) = 


1 In 


n + 1 \ n 


To see that this formula holds, consider the family V of all lattice paths from (0,0) 
to (n,n). A lattice path from (0,0) to ( n , n ) is just a {H, V}-string of length 2 n with 
exactly n H's. So \ r P\ = ( 2 ”). We classify the paths in V as good if they never go over 
the diagonal; otherwise, they are bad. A string s e V is good if the number of V's 
in an initial segment of s never exceeds the number of H's. For example, the string 
“ HHV HVV HHHV HVVV" is a good lattice path from (0,0) to (7, 7), while the path 
“ HV HV HHVVV HV HHV" is bad. In the second case, note that after 9 moves, we 
have 5 V's and 4 H's. 

Let Q and S denote the family of all good and bad paths, respectively. Of course, 
our goal is to determine \Q\. 
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Consider a path s e IB. Then there is a least integer i so that s has more V's than 
H' s in the first i positions. By the minimality of i, it is easy to see that i must be odd 
(otherwise, we can back up a step), and if we set i = 2 j + 1, then in the first 2 j + 1 
positions of s, there are exactly j H's and j + 1 V's. The remaining 2 n - 2j - 1 positions 
(the "tail of s") have n — j H's and n - j - 1 V's. We now transform s to a new string 
s' by replacing the H's in the tail of s by V's and the V's in the tail of s by H's and 
leaving the initial 2 j + 1 positions unchanged. For example, see Figure 2.29, where the 
path s is shown solid and s' agrees with s until it crosses the line y = x and then is the 
dashed path. Then s' is a string of length 2 n having (n - j) + (j + 1) = n + 1 V's and 
(n - j - 1) + j = n - 1 H's, so s' is a lattice path from (0, 0) to (n - 1, n + 1). Note that 
there are such lattice paths. 


(n-1,n+1) 

(n,n) 



Figure 2.29: Transforming a Lattice Path 


We can also observe that the transformation we've described is in fact a bijection 
between '£ and V , the set of lattice paths from (0, 0) to (n — 1, n + 1). To see that this 
is true, note that every path s' in P' must cross the line y = x, so there is a first time it 
crosses it, say in position i. Again, i must be odd, so i = 2j + 1 and there are j H's and 
j + 1 V's in the first i positions of s'. Therefore the tail of s' contains n + 1 — (j + 1) = n—j 
V's and (n — 1) — j H's, so interchanging H’s and V's in the tail of s' creates a new string 
s that has n H's and n V's and thus represents a lattice path from (0, 0) to (n, n), but 
it's still a bad lattice path, as we did not adjust the first part of the path, which results 
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in crossing the line y = x in position i. Therefore, \ 'B\ = YP'\ and thus 

l2n\ l In \ 1 tin 

C(n) = \Q\ = \P\ - \B\ = \V\ - \P'\ = 


n — 1/ n +l \ n r 


after a bit of algebra. 

It is worth observing that in Example 2.28, we made use of two common enumerative 
techniques: giving a bijection between two classes of objects, one of which is "easier" 
to count than the other, and counting the objects we do not wish to enumerate and 
deducting their number from the total. 


2.6 The Binomial Theorem 


Here is a truly basic result from combinatorics kindergarten. 

Theorem 2.30 (Binomial Theorem). Let x and y be real numbers with x, y and x + y non- 
zero. Then for every non-negative integer n, 


C x + y r = 2 

i = 0 



Proof. View ( x + y) n as a product 

(x + y) n = (x + y)(x + y)(x + y){x + y) ■ ■ ■ (x + y){x + y) . 

n factors 

Each term of the expansion of the product results from choosing either x or y from one 
of these factors. If x is chosen n - i times and y is chosen i times, then the resulting 
product is x n ~'y l . Clearly, the number of such terms is C(n , i), i.e., out of the n factors, 
we choose the element y from i of them, while we take x in the remaining n — i. □ 

Example 2.31. There are times when we are interested not in the full expansion of a 
power of a binomial, but just the coefficient on one of the terms. The Binomial Theorem 
gives that the coefficient of x 5 y s in (2x - 3 y) 13 is ( 1 5 3 )2 5 (-3) 8 . 

2.7 Multinomial Coefficients 

Let X be a set of n elements. Suppose that we have two colors of paint, say red and 
blue, and we are going to choose a subset of k elements to be painted red with the rest 
painted blue. Then the number of different ways this can be done is just the binomial 
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coefficient (".). Now suppose that we have three different colors, say red, blue, and 
green. We will choose k\ to be colored red, 1(2 to be colored blue, and the remaining 
k$ = n — (/ci + 1(2 ) are to be colored green. We may compute the number of ways to 
do this by first choosing k\ of the n elements to paint red, then from the remaining 
n—k\ elements choosing ki to paint blue, and then painting the remaining kj elements 
green. It is easy to see that the number of ways to do this is 

(n\(n-kA n\ (n - k{)\ n\ 

k 2 ) ki\(n - k{)\ k 2 ^(n — (k\ + k 2 ))\ kf^-kf. 

Numbers of this form are called multinomial coefficients; they are an obvious gener- 
alization of the binomial coefficients. The general notation is: 

/ n \ n ! 

\k\, h 2 , k 3 , . . . , k r J kf^-kf . . . . k r ! 


For example, 

( 8 ) = -*-= 40320 = 1680. 

\3,2, 1,2/ 3!2!1!2! 6-2-1 -2 

Note that there is some "overkill" in this notation, since the value of k r is determined 
by n and the values for k \ , 1(2, . . . , k r -i . For example, with the ordinary binomial coef- 
ficients, we just write ( 8 ) and not ( 3 8 5 ). 

Example 2.32. Flow many different rearrangements of the string: 

MITCHELTKELLERANDWILLIAMTTROTTERARE REGENIUSES!! 


are possible if all letters and characters must be used? 

Solution. To answer this question, we note that there are a total of 45 characters dis- 
tributed as follows: 3 A's, 1 C, 1 D, 7 E's, 1 G, 1 FI, 4 I's, 1 K, 5 L's, 2 M's, 2 N's, 1 O, 
4 R's, 2 S's, 6 T's, 1 U, 1 W, and 2 !'s. So the number of rearrangements is 

45! 

3!1!1!7!1!1!4!1!5!2!2!1!4!2!6!1!1!2! ’ 

Just as with binomial coefficients and the Binomial Theorem, the multinomial coef- 
ficients arise in the expansion of powers of a multinomial: 

Theorem 2.33 (Multinomial Theorem). Let x\, X 2 , . . . , x r he nonzero real numbers with 
Z;=i x i ^ 0. Then for every n e No, 


(jj + X2 + ' ' ' + Xr) n 


2 




k\,k 2 , ■ ■ ■ ,k, 


x k fx k 2 2 - 
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Example 2.34. What is the coefficient of x"y 60 z 14 in (2x 3 + y — z 2 ) 100 ? What about 

x"y 61 z 13 ? 

Solution. By the Multinomial Theorem, the expansion of (2x 3 + y — z 2 ) 100 has terms 
of the form 



2 h x 3h y kl (-l) k3 z 2k3 . 


The x"y 60 z 14 arises when k\ = 33, 1(2 = 60, and k$ = 7, so it must have coefficient 


_/ 100 L33 
\33,60,7/ ‘ 

For x"y 61 z 13 , the exponent on z is odd, which cannot arise in the expansion of (2x 3 + 
y - z 2 ) 100 , so the coefficient is 0. 


2.8 Discussion 

Over coffee, Xing said that he had been experimenting with the SageMath software 
discussed in Chapter 1. He understood that SageMath was treating a big integer as 
a string. Xing enthusiastically reported that he had asked SageMath to find the sum 
a + b of two large integers a and b, each having more than 800 digits. The software 
found the answer about as fast as he could hit the enter key on his netbook. "That's 
not so impressive," Alice interjected. "A human, even Bob, could do this in a couple of 
minutes using pencil and paper." 

"Thanks for your kind remarks," replied Bob, with the rest of the group noting that 
that Alice was being pretty harsh on Bob and not for any good reason. 

Dave took up Bob's case by remarking, "Very few humans, not even you Alice, would 
want to tackle finding the product of a and b by hand." Xing jumped back in with, 
"That's the point. Even a tiny netbook can find the product very, very quickly. In fact, 
I tried it out with two integers, each having more than one thousand digits. It found 
the product in about one second." Ever the skeptic, Zori said, "You mean you carefully 
typed in two integers of that size?" Xing quickly replied "Of course not. I just copied 
and pasted the data from one source to another." Yolanda said, "What a neat trick that 
is. Really cuts down the chance of an error." 

Dave said "What about factoring? Can your netbook with its fancy software for 
strings factor big integers?" Xing said that he would try some sample problems and 
report back. Carlos said "Factoring an integer with several hundred digits is likely 
to be very challenging, not only for a netbook, but also for a super computer. For 
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example, suppose the given integer was either a prime or the product of two large 
primes. Detecting which of these two statements holds could be very difficult." 

Undeterred, Dave continued, "What about exponentiation? Can your software cal- 
culate a b when a and b are large integers?" Xing said "That shouldn't be a problem. 
After all, a b is just multiplying a times itself a total of b times, and if you can do mul- 
tiplication quickly, that's just a loop." Yolanda said that the way Xing was describing 
things, he was actually talking about a program with nested loops so it might take a 
long time for such a program to halt. Carlos was quiet but he thought there might be 
ways to speed up such computations. 

By this time, Alice reinserted herself into the conversation: "Hey guys. While you 
were talking, I was looking for big integer topics on the web and found this problem. 
'Is 838200020310007224300 a Catalan number?' How would you answer this? Do you 
have to use special software?" 

Zori was not happy. She gloomily envisioned a future job hunt in which she was 
compelled to use big integer arithmetic as a job skill. Arrgghh. 


2.9 Exercises 

1. The Hawaiian alphabet consists of 12 letters. How many six-character strings can 
be made using the Hawaiian alphabet? 

2 . How many 2«-digit positive integers can be formed if the digits in odd positions 
(counting the rightmost digit as position 1 ) must be odd and the digits in even positions 
must be even and positive? 

3 . Matt is designing a website authentication system. He knows passwords are most 
secure if they contain letters, numbers, and symbols. However, he doesn't quite un- 
derstand that this additional security is defeated if he specifies in which positions each 
character type appears. He decides that valid passwords for his system will begin with 
three letters (uppercase and lowercase both allowed), followed by two digits, followed 
by one of 10 symbols, followed by two uppercase letters, followed by a digit, followed 
by one of 10 symbols. How many different passwords are there for his website system? 
How does this compare to the total number of strings of length 10 made from the al- 
phabet of all uppercase and lowercase English letters, decimal digits, and 10 symbols? 

4 . How many ternary strings of length 2 n are there in which the zeroes appear only 
in odd-numbered positions? 

5 . Suppose we are making license plates of the form hhh - d| where l\, C, h are 
capital letters in the English alphabet and d\,d 2 ,do, are decimal digits (i.e., elements 
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of the set 10,1,2,3,4,5,6,7,8,9}) subject to the restriction that at least one digit is 
nonzero and at least one letter is K. How many license plates can we make? 

6. Mrs. Steffen's third grade class has 30 students in it. The students are divided into 
three groups (numbered 1, 2, and 3), each having 10 students. 

(a) The students in group 1 earned 10 extra minutes of recess by winning a class 
competition. Before going out for their extra recess time, they form a single file 
line. In how many ways can they line up? 

(b) When all 30 students come in from recess together, they again form a single file 
line. However, this time the students are arranged so that the first student is from 
group 1, the second from group 2, the third from group 3, and from there on, the 
students continue to alternate by group in this order. In how many ways can they 
line up to come in from recess? 

7 . How many strings of the form I\l 2 did 2 d^l^lidil^l( ) are there where 

• for 1 < i < 6, /, is an uppercase letter in the English alphabet; 

• for 1 < i < 4 , d, is a decimal digit; 

• 1 2 is not a vowel (i.e., 1 2 i {A,E,I,0,U}); and 

• the digits d\, ^ 2 , and d$ are distinct (i.e., d\ + ^2 + do, + di). 

8. In this exercise, we consider strings made from uppercase letters in the English 
alphabet and decimal digits. How many strings of length 10 can be constructed in 
each of the following scenarios? 

(a) The first and last characters of the string are letters. 

(b) The first character is a vowel, the second character is a consonant, and the last 
character is a digit. 

(c) Vowels (not necessarily distinct) appear in the third, sixth, and eighth positions 
and no other positions. 

(d) Vowels (not necessarily distinct) appear in exactly two positions. 

(e) Precisely four characters in the string are digits and no digit appears more than 
one time. 

9 . A database uses 20-character strings as record identifiers. The valid characters in 
these strings are upper-case letters in the English alphabet and decimal digits. (Recall 
there are 26 letters in the English alphabet and 10 decimal digits.) How many valid 
record identifiers are possible if a valid record identifier must meet all of the following 
criteria: 
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• Letter (s) from the set {A, E, I, O, U} occur in exactly three positions of the string. 

• The last three characters in the string are distinct decimal digits that do not appear 
elsewhere in the string. 

• The remaining characters of the string may be filled with any of the remaining 
letters or decimal digits. 

10 . Let X be the set of the 26 lowercase English letters and 10 decimal digits. How 
many X-strings of length 15 satisfy all of the following properties (at the same time)? 

• The first and last symbols of the string are distinct digits (which may appear else- 
where in the string). 

• Precisely four of the symbols in the string are the letter 'f '. 

• Precisely three characters in the string are elements of the set V = {a, e, i, o , it } 
and these characters are all distinct. 

11 . A donut shop sells 12 types of donuts. A manager wants to buy six donuts, one 
each for himself and his five employees. 

(a) Suppose that he does this by selecting a specific type of donut for each person. 
(He can select the same type of donut for more than one person.) In how many 
ways can he do this? 

(b) How many ways could he select the donuts if he wants to ensure that he chooses 
a different type of donut for each person? 

(c) Suppose instead that he wishes to select one donut of each of six different types 
and place them in the breakroom. In how many ways can he do this? (The order 
of the donuts in the box is irrelevant.) 

12 . The sport of korfball is played by teams of eight players. Each team has four men 
and four women on it. Halliday High School has seven men and 11 women interested 
in playing korfball. In how many ways can they form a korfball team from their 18 
interested students? 

13. Twenty students compete in a programming competition in which the top four 
students are recognized with trophies for first, second, third, and fourth places. 

(a) How many different outcomes are there for the top four places? 

(b) At the last minute, the judges decide that they will award honorable mention 
certificates to four individuals who did not receive trophies. In how many ways 
can the honorable mention recipients be selected (after the top four places have 
been determined)? How many total outcomes (trophies plus certificates) are there 
then? 
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14 . An ice cream shop has a special on banana splits, and Xing is taking advantage of 
it. He's astounded at all the options he has in constructing his banana split: 

• He must choose three different flavors of ice cream to place in the asymmetric 
bowl the banana split is served in. The shop has 20 flavors of ice cream available. 

• Each scoop of ice cream must be topped by a sauce, chosen from six different 
options. Xing is free to put the same type of sauce on more than one scoop of ice 
cream. 

• There are 10 sprinkled toppings available, and he must choose three of them to 
have sprinkled over the entire banana split. 

(a) How many different ways are there for Xing to construct a banana split at this ice 
cream shop? 

(b) Suppose that instead of requiring that Xing choose exactly three sprinkled top- 
pings, he is allowed to choose between zero and three sprinkled toppings. In this 
scenario, how many different ways are there for him to construct a banana split? 

15 . Suppose that a teacher wishes to distribute 25 identical pencils to Ahmed, Barbara, 
Casper, and Dieter such that Ahmed and Dieter receive at least one pencil each, Casper 
receives no more than five pencils, and Barbara receives at least four pencils. In how 
many ways can such a distribution be made? 

16 . How many integer-valued solutions are there to each of the following equations 
and inequalities? 

(a) x\ + X 2 + X 3 + X 4 + X 5 = 63, all Xj > 0 

(b) xi + X 2 + X 3 + X 4 + X 5 = 63, all Xi > 0 

(c) xi + X 2 + X 3 + X 4 + X 5 < 63, all Xj > 0 

(d) x\ + X 2 + X 3 + X 4 + x$ = 63, all Xi > 0, X 2 > 10 

(e) x\ + X 2 + X 3 + X 4 + X 5 = 63, all x; > 0, X 2 < 9 

17 . How many integer solutions are there to the equation 

X\ 4- X 2 4- X 3 + X 4 = 132 

provided that x\ > 0, and X 2 , X 3 , X 4 > 0? What if we add the restriction that X 4 < 17? 

18 . How many integer solutions are there to the inequality 

Xi + X 2 + X 3 + X 4 + X 5 < 782 
provided that x\, X 2 > 0, X 3 > 0, and X 4 , X 5 > 10? 
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19 . A teacher has 450 identical pieces of candy. He wants to distribute them to his class 
of 65 students, although he is willing to take some leftover candy home. (He does not 
insist on taking any candy home, however.) The student who won a contest in the last 
class is to receive at least 10 pieces of candy as a reward. Of the remaining students, 34 
of them insist on receiving at least one piece of candy, while the remaining 30 students 
are willing to receive no candy. 

(a) In how many ways can he distribute the candy? 

(b) In how many ways can he distribute the candy if, in addition to the conditions 
above, one of his students is diabetic and can receive at most 7 pieces of candy? 
(This student is one of the 34 who insist on receiving at least one piece of candy.) 

20 . Give a combinatorial argument to prove the identity 


k 




Hint. Think of choosing a team with a captain. 

21 . Let m and w be positive integers. Give a combinatorial argument to prove that for 
integers k > 0, 

Z k I m\ I zv \ _ (m + w\ 

W / U - // = \ k I 

22. How many lattice paths are there from (0, 0) to (10, 12)? 

23 . How many lattice paths are there from (3, 5) to (10, 12)? 

24 . How many lattice paths are there from (0, 0) to (10, 12) that pass through (3, 5)? 

25 . How many lattice paths from (0, 0) to (17, 12) are there that pass through (7, 6) and 

(12,9)? 

26 . How many lattice paths from (0, 0) to (14, 73) are there that do not pass through 
(6,37)? 

27 . A small-town bank robber is driving his getaway car from the bank he just robbed 
to his hideout. The bank is at the intersection of 1 st Street and 1 st Avenue. He needs 
to return to his hideout at the intersection of 7 th Street and 5 th Avenue. However, one 
of his lookouts has reported that the town's one police officer is parked at the inter- 
section of 4 th Street and 4 th Avenue. Assuming that the bank robber does not want to 
get arrested and drives only on streets and avenues, in how many ways can he safely 
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return to his hideout? (Streets and avenues are uniformly spaced and numbered con- 
secutively in this small town.) 

28 . The setting for this problem is the fictional town of Mascotville, which is laid out 
as a grid. Mascots are allowed to travel only on the streets, and not "as the yellow jacket 
flies." Buzz, the Georgia Tech mascot, wants to go visit his friend Thundar, the North 
Dakota State University mascot, who lives 6 blocks east and 7 blocks north of Buzz's 
hive. However, Uga VIII has recently moved into the doghouse 2 blocks east and 3 
blocks north of Buzz's hive and already has a restraining order against Buzz. There's 
also a pair of tigers (mother and cub) from Clemson who live 1 block east and 2 blocks 
north of Uga VIII, and they're known for setting traps for Buzz. Buzz wants to travel 
from his hive to Thundar's pen every day without encountering Uga VIII or The Tiger 
and The Tiger Cub. However, he wants to avoid the boredom caused by using a route 
he's used in the past. What is the largest number of consecutive days on which Buzz 
can make the trip to visit Thundar without reusing a route (you may assume the routes 
taken by Buzz only go east and north)? 

29 . Determine the coefficient on x 15 y 120 z 25 in (2x + 3 y 2 + z) 100 . 

30 . Determine the coefficient on x 12 y 24 in (x 3 + 2 xy 2 + y + 3) 18 . (Be careful, as x and 
y now appear in multiple terms!) 

31 . For each word below, determine the number of rearrangements of the word in 
which all letters must be used. 

(a) OVERNUMEROUSNESSES 

(b) OFHTHALMOOTORHINOLARYNGOLOGY 

(c) HONORIFICABILITUDINITATIBUS (the longest word in the English language 
consisting strictly of alternating consonants and vowels 1 ) 

32 . How many ways are there to paint a set of 27 elements such that 7 are painted 
white, 6 are painted old gold, 2 are painted blue, 7 are painted yellow, 5 are painted 
green, and 0 of are painted red? 

33 . There are many useful sets that are enumerated by the Catalan numbers. (Vol- 
ume two of R.F. Stanley's Enumemtive Combinatorics contains a famous (or perhaps in- 
famous) exercise in 66 parts asking readers to find bijections that will show that the 
number of various combinatorial structures is C(n), and his web page boasts an ad- 
ditional list of at least 100 parts.) Give bijective arguments to show that each class of 
objects below is enumerated by C(n). (All three were selected from the list in Stanley's 
book.) 

x http: //www. rinkworks . com/words/oddities . shtml 
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(a) The number of ways to fully-parenthesize a product of n + 1 factors as if the "mul- 
tiplication" operation in question were not necessarily associative. For example, 
there is one way to parenthesize a product of two factors {a\ai), there are two ways 
to parenthesize a product of three factors (Oi ( 0203 )) and (Oi 02)03)), and there are 
five ways to parenthesize a product of four factors: 

0l0 2 («3«4))), Ol((>203)04)), (Ol02)(0304)), (Ol(fl203))04), (((0102)03)fl4). 

(b) Sequences of n l's and n -l's in which the sum of the first i terms is nonnegative 
for all i. 

(c) Sequences 1 < «i <•••<«„ of integers with a, < i. For example, for n = 3, the 
sequences are 

111 112 113 122 123. 

Hint. For part 2.9.33.C, think about drawing lattice paths on paper with grid lines and 
(basically) the number of boxes below a lattice path in a particular column. 
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CHAPTER 


Induction 


The twin concepts of recursion and induction are fundamentally important in com- 
binatorial mathematics and computer science. In this chapter, we give a number of 
examples of how recursive formulas arise naturally in combinatorial problems, and 
we explain how they can be used to make computations. We also introduce the Princi- 
ple of Mathematical Induction and give several examples of how it is applied to prove 
combinatorial statements. Our treatment will also include some code snippets that 
illustrate how functions are defined recursively in computer programs. 


3.1 Introduction 


A professor decides to liven up the next combinatorics class by giving a door prize. 
As students enter class (on time, because to be late is a bit insensitive to the rest of 
the class), they draw a ticket from a box. On each ticket, a positive integer has been 
printed. No information about the range of ticket numbers is given, although they are 
guaranteed to be distinct. The box of tickets was shaken robustly before the drawing, 
so the contents are thoroughly mixed, and the selection is done without looking inside 
the box. 

After each student has selected a ticket, the professor announces that a cash prize of 
one dollar (this is a university, you know) will be awarded to the student holding the 
lowest numbered ticket — from among those drawn. 

Must the prize be awarded? In other words, given a set of positive integers, in this 
case the set of ticket numbers chosen by the students, must there be a least one? More 
generally, is it true that in any set of positive integers, there is always a least one? What 
happens if there is an enrollment surge and there are infinitely many students in the 
class and each has a ticket? 
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3.2 The Positive Integers are Well Ordered 

Most likely, you answered the questions posed in Section 3.1 with an enthusiastic "yes", 
in part because you wanted the shot at the money, but more concretely because it seems 
so natural. But you may be surprised to learn that this is really a much more complex 
subject than you might think at first. In Appendix B, we discuss the development of the 
number systems starting from the Peano Postulates. Although we will not devote much 
space in this chapter to this topic, it is important to know that the positive integers 
come with "some assembly required." In particular, the basic operations of addition 
and multiplication don't come for free; instead they have to be defined. 

As a by-product of this development, we get the following fundamentally important 
property of the set N of positive integers: 

Principle 3.1 (Well Ordered Property of the Positive Integers). Every non-empty set of 
positive integers has a least element. 

An immediate consequence of the well ordered property is that the professor will 
indeed have to pay someone a dollar — even if there are infinitely many students in the 
class. 


3.3 The Meaning of Statements 

Have you ever taken standardized tests where they give you the first few terms of a 
sequence and then ask you for the next one? Here are some sample questions. In each 
case, see if you can determine a reasonable answer for the next term. 

1. 2,5,8,11,14,17,20,23,26,... 

2. 1,1, 2, 3, 5, 8, 13, 21, 34, 55, 89, 144, 233, 377, . . . 

3. 1,2, 5, 14, 42, 132, 429, 1430, 4862, . . . 

4. 2, 6, 12, 20, 30, 42, 56, 72, 90, 1 10, . . . 

5. 2,3,6,11,18,27,38,51,... 

Pretty easy stuff! OK, now try the following somewhat more challenging sequence. 
Here, we'll give you a lot more terms and challenge you to find the next one. 


1, 2, 3, 4, 1, 2, 3, 4, 5, 1, 2, 3, 4, 5, 2, 3,4, 5, 6, 2, 3, 4, 5, 6, 1, 2, 3, 4, 5, 2, 3, 4, 5, 6, . . . 


Trust us when we say that we really have in mind something very concrete, and once 
it's explained, you'll agree that it's "obvious." But for now, it's far from it. 
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Here's another danger lurking around the corner when we encounter formulas like 

„ ~ „ n ( n + 1 ) 
l+2 + 3 + -- - + n = — — - — - 


What do the dots in this statement mean? In fact, let's consider a much simpler ques- 
tion. What is meant by the following expression: 




Are we talking about the sum of the first six positive integers, or are we talking about 
the sum of the first 19 terms from the more complicated challenge sequence given 
above? You are supposed to answer that you don't know, and that's the correct answer. 

The point here is that without a clarifying comment or two, the notation 1+2 + 3 + 
• • • + 6 isn't precisely defined. Let's see how to make things right. 

First, let / : N — > N be a function. Set 

l 

2 /(*■) = /(!) 

i=i 


and if n > 1, define 

n n—1 

2 /(*)=/(») +2/(o 

i=l i=l 

To see that these two statements imply that the expression Yn=\ f(i) is defined for all 
positive integers, apply the Well Ordered Property to the set of all positive integers for 
which the expression is not defined and use the recursive definition to define it for the 
least element. 

So if we want to talk about the sum of the first six positive integers, then we should 
write: 

6 

Z' 

i=l 

Now it is clear that we are talking about a computation that yields 21 as an answer. 

A second example: previously, we defined n ! by writing 

h! = « x (k - 1) x (h - 2) x • • • x 3 x 2 x 1 

By this point, you should realize that there's a problem here. Multiplication, like ad- 
dition, is a binary operation. And what do those dots mean? Here's a way to do the 
job more precisely. Define n! to be 1 if n = 1. And when n > 1, set n\ = n(n - 1)!. 
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Definitions like these are called recursive definitions. They can be made with dif- 
ferent starting points. For example, we could have set n ! = 1 when n = 0, and when 
n > 0, set n\ = n(n - 1)!. 

Here's a code snippet in SageMath, which is based on Python, so this also works as 
Python code. 

def sumrecu r s i ve ( n) : 
if n == 1 : 

return 2; 
else : 

return sumrecursive (n-1 ) + (n*n - 2*n + 3) 
sumrecursive(3) 


1 1 

What is the value of sumrecursive (4)? (In order to make sure you understand how 
this recursive function works, calculate out sumrecursive(4) should be by hand before 
modifying the SageMath cell above.) Does it make sense to say that sumrecursive(n) 
is defined for all positive integers n ? Did you recognize that this program provides a 
precise meaning to the expression: 

2 + 3 + 6 + 11 + 18 + 27 + 38 + 51 + ■ ■ ■ + (n 2 -2n +3) 


3.4 Binomial Coefficients Revisited 


The binomial coefficient (£) was originally defined in terms of the factorial notation, 
and with our recursive definitions of the factorial notation, we also have a complete 
and legally-correct definition of binomial coefficients. The following recursive formula 
provides an efficient computational scheme. 

Let n and k be integers with 0 < k < n. If k = 0 or k = n, set (”) = 1. If 0 < k < n, set 


n — 1\ In -1 
k- 1 1 + 


This recursion has a natural combinatorial interpretation. Both sides count the number 
of /c-element subsets of {1, 2, . . . , n }, with the right-hand side first grouping them into 
those which contain the element n and then those which don't. The traditional form of 
displaying this recursion is shown in Table 3.2. This pattern is called "Pascal's triangle." 
Other than the Is at the ends of each row, an entry of the triangle is determined by 
adding the entry to the left and the entry to the right in the row above. 
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1 

1 

1 3 

1 4 

1 5 10 

1 6 15 

1 7 21 35 

1 8 28 56 


1 

1 


2 

3 

1 

1 




6 

10 

4 

5 

1 

1 


20 


15 


6 


1 


35 


21 


7 

1 

70 


56 


28 


8 1 


Table 3.2: Pascal's Triangle 


Xing was intrigued by the fact that he now had two fundamentally different ways 
to calculate binomial coefficients. One way is to write (”) = P(n, m)/(n - m)\ and just 
carry out the specified arithmetic. The second way is to use the recursion of Pascal's 
triangle, so that you are just performing additions. So he experimented by writing 
a computer program to calculate binomial coefficients, using a library that treats big 
integers as strings. Which of the two ways do you think proved to be faster when n say 
was between 1800 and 2000 and m was around 800? 


3.5 Solving Combinatorial Problems Recursively 

In this section, we present examples of combinatorial problems for which solutions 
can be computed recursively. In Chapter 9, we return to these problems and obtain 
even more compact solutions. Our first problem is one discussed in our introductory 
chapter. 

Example 3.3. A family of n lines is drawn in the plane with (1) each pair of lines cross- 
ing and (2) no three lines crossing in the same point. Let r(n) denote the number of 
regions into which the plane is partitioned by these lines. Evidently, r(l) = 2, r(2) = 4, 
r(3) = 7 and r(4) = 11. To determine r(n) for all positive integers, it is enough to note 
that r(l) = 1, and when n > 1, r(n) = n + r(n - 1). This formula follows from the 
observation that if we label the lines as Li, L 2 , . . . , L n , then the n — 1 points on line L„ 
where it crosses the other lines in the family divide L n into n segments, two of which 
are infinite. Each of these segments is associated with a region determined by the first 
n — 1 lines that has now been subdivided into two, giving us n more regions than were 
determined by n - 1 lines. This situation is illustrated in Figure 3.4, where the line con- 
taining the three dots is L 4 . The other lines divide it into four segments, which then 
divide larger regions to create regions 1 and 5, 2 and 6 , 7 and 8 , and 4 and 9. 
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Figure 3.4: Lines and regions in the plane 


With the recursive formula, we thus have r(5) = 5 + 11 = 16, r{ 6) = 6 + 16 = 22 
and r(7) = 7 + 22 = 29. Even by hand, it wouldn't be all that much trouble to calculate 
r(100). We could do it before lunch. 

Example 3.5. A 2 x n checkerboard will be tiled with rectangles of size 2x1 and 1x2. 
Find a recursive formula for the number t(n) of tilings. Clearly, f(l) = 1 and f(2) = 2. 
When n > 2, consider the rectangle that covers the square in the upper right corner. 
If it is vertical, then preceding it, we have a tiling of the first n — 1 columns. If it is 
horizontal, then so is the rectangle immediately underneath it, and proceeding them 
is a tiling of the first n — 2 columns. This shows that t(n ) = t(n - 1) + t(n - 2). In 
particular, f( 3) = 1+2 = 3, f(4) = 2 + 3 = 5 and t( 5) = 3 + 5 = 8. 

Again, if compelled, we could get f(100) by hand, and a computer algebra system 
could get f(1000). 

Example 3.6. Call a ternary string good if it never contains a 2 followed immediately by 
a 0; otherwise, call it bad. Let g(n) be the number of good strings of length n. Obviously 
g(I ) = 3, since all strings of length 1 are good. Also, g(2) = 8 since the only bad string 
of length 2 is (2, 0). Now consider a value of n larger than 2. 

Partition the set of good strings of length n into three parts, according to the last 
character. Good strings ending in 1 can be preceded by any good string of length n — 1, 
so there are g(n - 1) such strings. The same applies for good strings ending in 2. For 
good strings ending in 0, however, we have to be more careful. We can precede the 0 by 
a good string of length n — 1 provided that the string does not end in 2. There are g(n — l) 
good strings of length n — 1 and of these, exactly g(n - 2) end in a 2. Therefore there 
are g(n - 1) - g(n - 2) good strings of length n that end in a 0. Hence the total number 
of good strings of length n satisfies the recursive formula q(n) = 3 q(n - 1) - q(n - 2). 
Thus g( 3) = 3 ■ 8 - 3 = 21 and ^(4) = 3 ■ 21 - 8 = 55. 
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Once more, (/(100) is doable by hand, while even a modest computer can be coaxed 
into giving us <7(5000). 

3.5.1 Finding Greatest Common Divisors 

There is more meat than you might think to the following elementary theorem, which 
seems to simply state a fact that you've known since second grade. 

Theorem 3.7 (Division Theorem). Let m and n be positive integers. Then there exist unique 
integers q and r so that 

m = q ■ n + r and 0 < r < n . 

We call q the quotient and r the remainder. 

Proof. We settle the claim for existence. The uniqueness part is just high-school algebra. 
If the theorem fails to hold, then let t be the least positive integer for which there are 
integers m and n with m + n = t, but there do not exist integers q and r with m - qn+r 
and 0 < r < n . 

First, we note that n + 1, for if n = 1, then we could take q = in and r = 0. Also, we 
cannot have m = 1, for if m = 1, then we can take q = 0 and r = 1. Now the statement 
holds for the pair m - 1, n so there are integers q and r so that 

m - 1 = q ■ n + r and 0 < r < n . 

Since r < n, we know that r + 1 < n. If r + 1 < n, then 

m = q ■ n + (r + 1) and 0 < r + 1 < n . 

On the other hand, if r + 1 = n, then 

m = q ■ n + (r + 1) = nq + n = (q + 1 )n = (q + 1 )n + 0. 

The contradiction completes the proof. □ 

Recall that an integer n is a divisor of an integer m if there is an integer q such that 
m = qn. (We write n \ m and read "n divides m" .) An integer d is a common divisor 
of integers m and n if d is a divisor of both m and n . The greatest common divisor of 
m and n, written gcd(m, n), is the largest of all the common divisors of m and n. 
Here's a particularly elegant application of the preceding basic theorem: 

Theorem 3.8 (Euclidean Algorithm). Let m, n be positive integers with m > n and let q 
and r be the unique integers for which 

m = q ■ n +r and 0 < r < n . 

Ifr> 0, then gcd (m, n) = gcd (n,r). Ifr = 0, then n divides m, and gcd(wz, n) = n. 
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Proof. Consider the expression m = q • n + r, which is equivalent to m - q ■ n = r. If a 
number d is a divisor of m and n , then d must also divide r. Similarly, if d is a divisor 
of n and r , then d must also divide rn. □ 

Here is a code snippet that computes the greatest common divisor of m and n when 
m and n are positive integers with m > n. We use the familiar notation m%n to denote 
the remainder r in the expression m = q ■ n + r, with 0 < r < n. 


def 

gcd (m 

n) : 


if in ! 

n == 0 : 


return n 


else : 



return gcd(n,m%n) 

gcd 

(12,5) 



Feel free to change the values 1 2 and 5 above in the SageMath cell in the HTML 
version of the text to calculate the greatest common divisor of some other integers. 
Just remember that the code assumes m > n when you do so! 

The disadvantage of this approach is the somewhat wasteful use of memory due to 
recursive function calls. It is not difficult to develop code for computing the greatest 
common divisor of m and n using only a loop, i.e., there are no recursive calls. With 
minimal extra work, such code can also be designed to solve the following diophantine 
equation problem: 

Theorem 3.9. Let m, n, and c he positive integers. Then there exist integers a and h, not 
necessarily non-negative, solving the linear diophantine equation am + bn = c if and only ifc 
is a multiple of the greatest common divisor ofm and n. 

Let's see how the Euclidean algorithm can be used to write gcd(m, n) in the form 
am + bn with a,b e Z with the following example. 

Example 3.10. Find the greatest common divisor d of 3920 and 252 and find integers 
a and b such that d = 3920 a + 252 b. 

Solution. In solving the problem, we demonstrate how to perform the Euclidean al- 
gorithm so that we can find a and b by working backward. First, we note that 

3920 = 15 ■ 252 + 140. 

Now the Euclidean algorithm tells us that gcd(3920,252) = gcd(252, 140), so we write 

252 = 1 ■ 140 + 112. 
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Continuing, we have 140 = 1 • 112 + 28 and 112 = 4 • 28 + 0, so d =28. 

To find a and b, we now work backward through the equations we found earlier, 
"solving" them for the remainder term and then substituting. We begin with 

28 = 140 - 1 ■ 112. 

But we know that 112 = 252 - 1 ■ 140, so 

28 = 140 - 1(252 - 1 ■ 140) = 2 ■ 140 - 1 ■ 252. 

Finally, 140 = 3920 - 15 • 252, so now we have 

28 = 2(3920 - 15 ■ 252) - 1 ■ 252 = 2 • 3920 - 31 ■ 252. 

Therefore a = 2 and b = —31. 

3.5.2 Sorting 

One of the most common and most basic computing problems is sorting: Given a se- 
quence a \ , U 2 , ■ ■ ■ , a n of n distinct integers, rearrange them so that they are in increasing 
order. We describe here an easy recursive strategy for accomplishing this task. This 
strategy is known as Merge Sort, and it is one of several optimal algorithms for sorting. 
Introductory computer science courses treat this topic in greater depth. In our course, 
we simply need some good strategy and merge sort works fine for our purposes. 

To present merge sort, must first develop a strategy for solving a special case of the 
sorting problem. Suppose we have s + t distinct integers 

{uo, Mi, . . . , u s - 1, v 0 , v\, ..., V t -l} 

arranged as two lists with Uo < Ui < ... < u s -i and z’o < W < • • • < Vt-l- How do we 
merge these two sequences into a single increasing sequence of length s + 1 . Imagine the 
two sequences placed on two horizontal lines, one immediately under the other. Then 
let u be the least integer in the first sequence and v the least integer in the second. At 
the moment, this implies that u = uq and v = Vq, but integers will be deleted from the 
two sequences as the process is carried out. Regardless, the meaning of u and v will 
be preserved. Also, set i = 0. Then take a, as the minimum of u and v and delete fl, 
from the sequence in which it occurs. Then increase i by 1 and repeat. Here is a code 
snippet for accomplishing a merge operation, with Up now written as u[p] and Vn now 
written as v[q], 

u = [1,2,7,9,11,15] 
v = [3,5,8,100,130, 275] 
a = [] 
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p = 0 

q = 0 

for i in range(len(u) + len(v)): 

if (p < len(u) and q < len(v)): 
a . append ( min (u [p] , v[q])) 
if (min (u[p] , v[q])==u[p]) : 

P = P + 1 
else : 

q = q+1 

elif (p >= len (u) ) : 
a. append(v[q]) 
q = q + 1 
else : 

a . append (u [p] ) 

P = P + 1 


[ 1 , 2 , 3 , 5 , 7 , 8 , 9 , 11 , 15 , 100 , 130 , 275 ] 

Now that we have a good strategy for merging, it is easy to develop a recursive strat- 
egy for sorting. Given a sequence a\, aj, . . . , a n of n distinct integers, we set s = \n /2] 
and t = \_n!2\. Then let it; = a; for i = 1,2, ... ,s and v; = a s+ j, for j = 1,2, ... ,t. 
Sort the two subsequences and then merge them. For a concrete example, given the 
sequence (2, 8 , 5, 9, 3, 7, 4, 1, 6), we split into (2, 8 , 5, 9, 3) and (7, 4, 1, 6). These subse- 
quences are sorted (by a recursive call) into (2, 3, 5, 8 , 9) and (1,4, 6, 7), and then these 
two sorted sequences are merged. 

For running time, if S(n) is the number of operations it takes to sort a sequence of n 
distinct integers, then S(2n) < 2 S(n) + 2 n, since it clearly takes 2 n steps to merge two 
sorted sequences of length n . This leads to the bound S(n) < Cn log n for some positive 
constant C, and in computer science courses, you will learn (here it is an exercise) that 
this is optimal. 


3.6 Mathematical Induction 

Now we move on to induction, the powerful twin of recursion. 

Let n be a positive integer. Consider the following mathematical statements, each of 
which involve n : 

1. 2 n+7 = 13. 

2. 3n - 5 = 9. 
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3. n 2 - 5n + 9 = 3. 

4. 8n - 3 < 48. 

5. 8n - 3 > 0. 

6. (n + 3 )(n + 2) = n 2 + 5n + 6. 

7. n 2 - 6n + 13 > 0. 

Such statements are called open statements. Open statements can be considered as 
equations, i.e., statements that are valid for certain values of n . Statement 1 is valid 
only when n = 3. Statement 2 is never valid, i.e., it has no solutions among the positive 
integers. Statement 3 has exactly two solutions, and Statement 4 has six solutions. On 
the other hand. Statements 5, 6 and 7 are valid for all positive integers. 

At this point, you are probably scratching your head, thinking that this discussion 
is trivial. But let's consider some statements that are a bit more complex. 

1. The sum of the first n positive integers is n(n + l)/2. 

2. The sum of the first n odd positive integers is n 2 . 

3. n n > n\ +4,000,000,000n2 n when n > 14. 

How can we establish the validity of such statements, provided of course that they 
are actually true? The starting point for providing an answer is the following property: 

Principle 3.11 (Principle of Mathematical Induction). Let S„ be an open statement in- 
volving a positive integer n. If Si is true, and if for each positive integer k, assuming that the 
statement Sk is true implies that the statement Sjt+i is true, then S„ is true for every positive 
integer n . 

With a little thought, you should see that the Principle of Mathematical Induction is 
logically equivalent to the Well Ordered Property of the Positive Integers. If you haven't 
already done so, now might be a good time to look over Appendix B on background 
material. 


3.7 Inductive Definitions 

Although it is primarily a matter of taste, recursive definitions can also be recast in an 
inductive setting. As a first example, set 1! = 1 and whenever k\ has been defined, set 
(Jfc + 1)! = (Jfc + l)Jfc!. 
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As a second example, set 

1 k+l k 

2 /(*')= /(i) Z/ (f) = E/ (i)+ / (fc+1) 

i=l i=l i=l 

In this second example, we are already using an abbreviated form, as we have omitted 
some English phrases. But the meaning should be clear. 

Now let's back up and give an example which would really be part of the develop- 
ment of number systems. Suppose you knew everything there was to know about the 
addition of positive integers but had never heard anything about multiplication. Here's 
how this operation can be defined. 

Let m be a positive integer. Then set 

m ■ 1 = m and m ■ (k + 1) = m ■ k + m 

You should see that this defines multiplication but doesn't do anything in terms of estab- 
lishing such familiar properties as the commutative and associative properties. Check 
out some of the details in Appendix B. 


3.8 Proofs by Induction 


No discussion of recursion and induction would be complete without some obligatory 
examples of proofs using induction. We start with the "Hello World" example. 

Proposition 3.12. For every positive integer n, the sum of the first n positive integers is n(n + 
l)/2, i.e., 



n(n + 1) 
2 


For our first version of a proof of Proposition 3.12, we clearly identify the open state- 
ment S n and describe the proof carefully in terms of S n . As you develop more experi- 
ence with writing proofs by induction, this will become less essential, as you'll see in 
the second version of the proof. 


Proof. Let n be a positive integer, and let S n be the open statement 


£ 


i = 


n(n + 1) 
2 


We will prove that S n is true for all positive integers by induction. For the basis step, 
we must prove that Si is true. When n = 1, the left-hand side of S n is just 1, while the 
right-hand side evaluates to 1(1 + l)/2 = 1. Therefore, Si is true. 
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Next we assume that for some positive integer k, S/t is true. That is, we assume 


2 > 


k(k + 1) 


i=i 

We now seek to prove that Sk+i is true, and begin by considering the left-hand side of 
Sk + 1 ■ We notice that 


g j= (£/U +1)= e±i> +( * +1) , 

i=i \ i=i / 

since our inductive hypothesis that Sk is true gives us the simpler formula for the sum- 
mation. Now continuing with a bit of algebra, we find 

Jfc(Jfc + 1) ,, k 2 + 3k + 2 (Jfc + l)(Jfc+2) 

2 2 2 

Therefore, S/t+i is true. Since we have shown that Si is true and that for every positive 
integer k, if S jt is true, then Sjt+i is true, we conclude that S„ is true for all positive 
integers n by the Principle of Mathematical Induction. □ 

Before looking at a refined version of this proof, let's take a moment to discuss the 
key steps in every proof by induction. The first step is the basis step, in which the open 
statement Si is shown to be true. (It's worth noting that there's nothing special about 
1 here. If we want to prove only that S„ is true for all integers n > 5, then proving that 
S5 is true is our basis step.) When proving the basis step, if S n is an equation, we do 
not just write down Si and move on. We need to prove that Si is true. Notice how in 
the proof above, we discussed the left-hand side of Si and the right-hand side of Si 
and concluded that they were equal. 

After the basis step comes the inductive step, in which we assume that S/t is true 
for some positive integer k and prove that Sk + 1 is true. When doing this, we call S/ c 
our inductive hypothesis. In the inductive step, the most common mistake students 
make is starting with the entirety of S/ f+ i and manipulating it until they obtain a true 
statement. This is dangerous, as it is possible to start with something false and through 
valid algebraic steps, obtain a true statement. Instead, the best option is to work as with 
the basis step: if Sjt+i is an equation or inequality, work on one side until you find a 
place to apply the inductive hypothesis and then continue until you obtain the other 
side. If the algebra gets tricky along the way, you can also work with the left-hand 
side of Sjt+i and separately work with the right-hand side of S^+i- If you're able to 
manipulate both sides to be in the same form, then you have shown they are equal and 
St+i is true. 
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Now let's take a look at a more refined proof of Proposition 3.12. From here on, 
when we give a proof by induction, we'll use this style. As you're getting started with 
induction proofs, you may find it useful to be more explicit about the steps as we did 
in the first proof above. 


Proof. We first prove the assertion when n = 1. For this value of n, the left-hand side 
is just 1, while the right-hand side evaluates to 1(1 + 1) /2 = 1. 

Now assume that for some positive integer k, the formula holds when n = k, i.e., 
assume that 


£ 


i = 


k(k + 1) 
2 


Then it follows that 


k+l 


Y f ■ Xi f + + ^ - 


k(k + 1) 


+ (* + !) = 


k 2 + 3k + 2 (Jfc + 1 )(k + 2) 


i=i 


u=l 


Thus the formula also holds when n = k + 1. By the Principle of Mathematical Induc- 
tion, it holds for all positive integers n . □ 

The preceding arguments are 100% correct... but some combinatorial mathemati- 
cians would argue that they may actually hide what is really going on. These folks 
would much prefer a combinatorial proof, as was provided in Section 2.4. Our per- 
spective is that you should prefer to give a combinatorial proof — when you can find 
one. But if pressed, you should be able to give a formal proof by mathematical induc- 
tion. 

Here's a second example, also quite a classic. Again, recall that we gave a combina- 
torial proof in the last chapter. As you read the proof, make sure you can identify the 
open statement S„, the basis step, and the inductive step. 

Proposition 3.13. For each positive integer n, the sum of the first n odd positive integers is 
n 2 , i.e., 

Yjli - 1) = n 2 . 
i=i 

Proof. We will prove this by induction. First, note that the formula holds when n = 1 . 
Now suppose that A: is a positive integer and that the formula holds when n = k, i.e., 
assume 

Yp-i - 1 ) = k 2 . 

i=i 
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Then 

k+l / k \ 

^T(2; - 1) = 2f - 1 + + 1 = fc 2 + (2A: + 1) = (A: + 1 ) 2 . 

;=i \ i=i / 

Therefore, the proposition follows by the Principle of Mathematical Induction. □ 

Here's a more general version of the first result in this section, and again we note 
that we gave a combinatorial proof in Section 2.4. 

Proposition 3.14. Let n and k be non-negative integers with n > k. Then 


E 



n + 1 
k + l 


Proof. Fix a non-negative integer k. We then prove the formula by induction on n. If 
n = k, note that the left hand side is just (jjj) = 1, while the right hand side is 
which is also 1. Now assume that m is a non-negative integer, with m > k, and that 
the formula holds when n = m, i.e., assume that 


Then 



/ m + 1 \ 

U+i/ 


m+1 


z 




(m + 1 \ 
\k + l) 


+ 


m + 1 
k 


/m +l\ 

\ * ) 


I m + 2\ 

U+ij- 


Therefore, the proposition follows by the Principle of Mathematical Induction. □ 


3.9 Strong Induction 

There are occasions where the Principle of Mathematical Induction, at least as we have 
studied it up to this point, does not seem sufficient. Here is a concrete example. The 
professor asked Bob to study a function f(n) defined recursively by f(n) = 2 f(n — 1) — 
/(« - 2) with /( 1) = 3 and /( 2) = 5. Specifically, the professor asked Bob to compute 


53 


Chapter 3 Induction 

/(10 10 ), which seems like a daunting task. Over coffee. Bob scribbled on a napkin and 
determined that /( 3) = 7 and /( 4) = 9, and on the basis of these calculations alone, he 
thought that it might just be possible that f(n) = 2n + 1 for all n > 1. If this were true, 
he could simply report that /(10 10 ) = 2 • 10 10 + 1 = 20000000001. 

Bob was beginning to understand proofs by induction, so he tried to prove that 
f(n) = 2n + 1 for all n > 1 by induction. For the base step, he noted that /( 1) = 3 = 
2 • 1 + 1, so all is ok to this point. For the inductive step, he assumed that f(k) = 2k + 1 
for some k > 1 and then tried to prove that f(k + 1) = 2(k + 1) + 1. If this step could be 
completed, then the proof by induction would be done. 

But at this point. Bob seemed to hit a barrier, because 

f(k + 1) = 2f(k) - f(k - 1) = 2(2 k + 1) - f(k - 1), 

using the inductive hypothesis to replace f(k) by 2/c + 1 . Flowever, he's was totally 
perplexed about what to do with the f(k - 1). If he knew that f(k - 1) = 2(k — 1) + 1, 
then the right hand side would result in 2(2 k + 1) - (2k - 1) = 2k + 3 = 2(k + 1) + 1, 
which is exactly what he wants. Bob always plays by the rules, and he has to admit 
that he doesn't know that f(k - 1) = 2 (k — 1) + 1. Fie only knows that f(k) = 2k + 1. 

Bob was about to throw in the towel and ask his computer to start making the cal- 
culations recursively, when Carlos comes along and asks what he's doing. Carlos sees 
right away that the approach Bob was taking to prove that f(n ) = 2n + 1 by induction 
won't work — but after a moment's reflection, Carlos says that there's a stronger form 
of an inductive proof that will do the trick. Carlos patiently explained to Bob a propo- 
sition which is called the Strong Principle of Mathematical Induction. To prove that 
an open statement S n is valid for all n > 1, it is enough to 

a Show that Si is valid, and 

b Show that Sjt+i is valid whenever S m is valid for all integers m with 1 < m < k. 

The validity of this proposition is trivial since it is stronger than the principle of in- 
duction. What is novel here is that in order to prove a statement, it is sometimes to 
your advantage to prove something even stronger. Combinatorial mathematicians call 
this the "bootstrap" phenomenon. 

Equipped with this observation. Bob saw clearly that the strong principle of induc- 
tion was enough to prove that /(«) = 2n + 1 for all n > 1. So he could power down his 
computer and enjoy his coffee. 


3.10 Discussion 

The group was debating the value of combinatorial proofs versus formal proofs by in- 
duction. Xing said that he actually preferred to do a proof by induction, as a combina- 
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torial proof, it could be argued, wasn't really a proof. Dave mumbled "Combinatorial 
proofs can always be made rigorous." They went back and forth for a while and then 
Alice said "But the professor never explained that weird sequence 


1 , 2 , 3 , 4 , 1 , 2 , 3 , 4 , 5 , 1 , 2 , 3 , 4 , 5 , 2 , 3 , 4 , 5 , 6 , 2 , 3 , 4 , 5 , 6 , 1 , 2 , 3 , 4 , 5 , 2 , 3 , 4 , 5 , 6 , ... , 


did he?" 

Dave was on a roll. He asked, "Who has change for a dollar?" but nobody under- 
stood why he would derail an argument over proofs when everybody had already paid 
for the coffee. Alice was more to the point "You know Dave, sometimes I just don't un- 
derstand why you say the things you do." Dave smiled (maybe it was more of a smirk) 
"It's about making change. The terms in this sequence are the fewest number of coins 
required to make change." Bob said "I don't get it." Dave continued "The term a„ is 
the fewest number of U.S. coins required to total to n cents." Now everyone groaned, 
everyone except Carlos, who thought that at least this time, Dave was really clever. 

"Well", said Bob, "that takes care of the strange sequence, but I still don't see any 
difference between induction and recursion." Dave couldn't keep quiet "No one does." 
Xing thought differently and said "In many programming languages, you try to avoid 
recursion, preferring to use loops instead. Otherwise, you wind up overloading the 
stack. As just one example, you can compute the greatest common divisor d of m and 
n, as well as find a and b so that d = am + bn using a loop — with very little storage. The 
recursive approach discussed previously, with the inherent back tracking at the end, 
isn't really necessary." Yolanda was impressed with Xing's extensive programming 
experience and knowledge, but Alice was less so. 

Zori was losing her patience and was especially grumpy today "I don't see any value 
to any of this stuff. Who's going to pay me to find greatest common divisors?" Dave 
said "Nobody." Alice said, "But maybe there are some principles here that have prac- 
tical application." Carlos joined in, saying "I think the basic principles behind estab- 
lishing that a computer program does what you intend have a lot to do with induction 
and recursion." Bob said "I don't understand. When I write a program, I just pay at- 
tention to details and after just a few corrections, they always work." Alice was brutal 
"Maybe that's because you don't do anything complicated." Carlos was more gentle 
"Big software projects might have hundreds of thousands of lines of code, and pieces 
of the final product might be written by different groups of programmers at different 
moments in time. Establishing correctness can be a very difficult task." Zori's ears 
perked up as she thought she saw something in this last bit of conversation that might 
be a way to earn a salary. 
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3.11 Exercises 

1. A database uses record identifiers that are alphanumeric strings in which the 10 
decimal digits and 26 upper-case letters are valid symbols. The criteria that define a 
valid record identifier are recursive. A valid record identifier of length n > 2 can be 
constructed in the following ways: 

• beginning with any upper-case letter other than D and followed by any valid 
record identifier of length n — 1; 

• beginning with 1 C, 2K, or 7/ and followed by any valid record identifier of length 
n - 2; or 

• beginning with D and followed by any string of n — 1 decimal digits. 

Let r(n) denote the number of valid record identifiers of length n. We take r(0) = 1 
and note that r(l) = 26. Find a recursion for r(n) when n > 2 and use it to compute 

r( 5). 

2. Consider alxti checkerboard. The squares of the checkerboard are to be painted 
white and gold, but no two consecutive squares may both be painted white. Let p(n) 
denote the number of ways to paint the checkerboard subject to this rule. Find a recur- 
sive formula for p(n) valid for n > 3. 

3. Give a recursion for the number g(n) of ternary strings of length n that do not con- 
tain 102 as a substring. 

4. A 2 X n checkerboard is to be tiled using two types of tiles. The first tile is a 1 X 1 
square tile. The second tile is called an L-tile and is formed by removing the upper- 
right lxl square from a 2 X 2 tile. The L-tiles can be used in any of the four ways they 
can be rotated. (That is, the "missing square" can be in any of four positions.) Let t(n ) 
denote the number of tilings of the 2 X n checkerboard using lxl tiles and L-tiles. Find 
a recursive formula for t(n) and use it to determine f(7). 

5. Let S be the set of strings on the alphabet {0, 1, 2, 3} that do not contain 12 or 20 as 
a substring. Give a recursion for the number h(n) of strings in S of length n. 

Hint. Check your recursion by manually computing h( 1), h( 2), h( 3), and h( 4). 

6. Find d = gcd(5544, 910) as well as integers a and b such that 5544 a + 910b = d. 

7. Find gcd(827, 249) as well as integers a and b such that 82 7a + 249 b = 6. 

8. Let a, b, m, and n be integers and suppose that am + bn = 36. What can you say 
about gcd(m, «)? 
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9 . (A challenging problem) For each formula, give both a proof using the Principle of 
Mathematical Induction and a combinatorial proof. One of the two will be easier while 
the other will be more challenging. 


(a) l 2 + 2 2 + 3 2 + ■ • ■ + n 2 


n(n + 1)(2 n + 1) 
6 



10 . Show that for all integers n > 4, 2" < n\. 

11 . Show that for all positive integers n, 


n 

^ 2 ' = 2" +1 - 1 . 
i=0 


12 . Show that for all positive integers n, 7 n - 4” is divisible by 3. 

13 . Show that for all positive integers n, 9" - 5" is divisible by 4. 

14 . It turns out that if a and b are positive integers with a > b + 1, then there is a 

positive integer M > 1 such that a" - b n is divisible by M for all positive integers n. 

Determine M in terms of a and b and prove that it is a divisor of a" - b" for all positive 
integers n. 


15 . Use mathematical induction to prove that for all integers n > 1, 


n 3 +(n + l) 3 + (n + 2) 3 


is divisible by 9. 

16 . Give a proof by induction of the Binomial Theorem (Theorem 2.30). How do you 
think it compares to the combinatorial argument given in Chapter 2? 

17 . Consider the recursion given by /(«) = 2 f(n - 1) - f(n - 2) + 6 for n >2 with 
/( 0) = 2 and /( 1) = 4. Use mathematical induction to prove that f(n) = 3 n 2 — n + 2 
for all integers n > 0. 

18 . Consider the recursion given by f(n ) = f(n - 1) + f(n - 2) for n > 3 with /( 1) = 
/( 2) = 1. Show that f(n ) is divisible by 3 if and only if n is divisible by 4. 

19 . Suppose that x e R and x > -1. Prove that for all integers n > 0, (1 + x)” > 1 + nx. 
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20. Show that there is a positive constant c so that any algorithm that sorts a sequence 
of n positive integers must, in worst case, take cn log n steps. 

Hint. Hint: There are n ! permutations of a set of n distinct integers. Each operation 
reduces the number of possibilities by a multiplicative fraction which is at most 1/2. 
So if there are f operations, then 2 l > n\. Now look up Stirling's approximation for n\ 
and continue from there. 
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Dave hates doing the same thing twice. He sees herself as a free spirit and never wants 
to fall into a rut. Alice says that this approach to life requires one to have lots and lots 
of options, for if you have to do a lot of something, like get up in the morning and get 
dressed, then you may not be able to avoid mindless repetition, dull and boring as it 
may seem. 


4.1 The Pigeon Hole Principle 

A function / : X — » Y is said to be 1-1 (read one-to-one) when f(x) + f(x ') for 
all x,x' e X with x + x' . A 1-1 function is also called an injection or we say that 
/ is injective. When / : X — > Y is 1-1, we note that |X| < |Y|. Conversely, we 
have the following self-evident statement, which is popularly called the "Pigeon Hole" 
principle. 

Proposition 4.1 (Pigeon Hole Principle). If f : X — » Y is a function and |X| > \Y\, then 
there exists an element y e Y and distinct elements x, x' e X so that fix) = fix') = y. 

In more casual language, if you must put n + 1 pigeons into n holes, then you must 
put two pigeons into the same hole. 

Here is a classic result, whose proof follows immediately from the Pigeon Hole Prin- 
ciple. 

Theorem 4.2 (Erdos /Szekeres). If m and n are non-negative integers, then any sequence of 
mn + 1 distinct real numbers either has an increasing subsequence ofm + 1 terms, or it has a 
decreasing subsequence of n + 1 terms. 

Proof. Let a = {x\, X 2 , xj, , x mn+ f) be a sequence of mn +1 distinct real numbers. 
For each i = 1,2, ... , mn + 1, let fl, be the maximum number of terms in a increasing 
subsequence of a with x, the first term. Also, let b, be the maximum number of terms 
in a decreasing subsequence of o with Xj the last term. If there is some i for which 
a, > m + 1, then o has an increasing subsequence of in + 1 terms. Conversely, if for 
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some i, we have bj > n + 1, then we conclude that o has a decreasing subsequence of 
n + 1 terms. 

It remains to consider the case where a, < in and bi < n for all i = 1,2, ... ,mn + 1. 
Since there are mn ordered pairs of the form (a, b) where 1 < a < m and 1 < b < n, 
we conclude from the Pigeon Hole principle that there must be integers i\ and C with 
1 < z’i < z '2 ^ mn + 1 for which (fl ; ir bj 2 ) = (fl; 2 , i>,- 2 ). Since x ;i and x* 2 are distinct, we 
either have Xj 1 < x, 2 or x h > x, 2 . In the first case, any increasing subsequence with 
Xi 2 as its first term can be extended by prepending x l} at the start. This shows that 
fljj > fl; 2 . In the second case, any decreasing sequence of with x t] as its last element can 
be extended by adding x l2 at the very end. This shows b, 2 > bj 2 . □ 

In Chapter 11, we will explore some powerful generalizations of the Pigeon Hole 
Principle. All these results have the flavor of the general assertion that total disarray is 
impossible. 

4.2 An Introduction to Complexity Theory 

Discussion 4.3. Bob says that he's really getting to like this combinatorial mathemat- 
ics stuff. The concrete nature of the subject is appealing. But he's not sure that he 
understands the algorithmic component. Sometimes he sees how one might actually 
compute the answer to a problem — provided he had access to a powerful computer. At 
other times, it seems that a computational approach might be out of reach, even with 
the world's best and fastest computers at ready access. Carlos says it can be much 
worse than that. There are easily stateable problems that no one knows how to attack 
even if all the world's computational power is used in concert. And there's nothing on 
the horizon that will change that. In fact, build faster computers and you just change 
the threshold for what is computable. There will still be easily understood problems 
that will remain unresolved. 


4.2.1 Three Questions 

We consider three problems with a common starting point. You are given 1 a set S of 
10, 000 distinct positive integers, each at most 100, 000, and then asked the following 
questions. 

1. Is 83, 172 one of the integers in the set S? 

2. Are there three integers in S whose sum is 143, 297? 

1 The particulars of how the set is given to you aren't important to the discussion. For example, the data 
could be given as a text file, with one number on each line. 
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3. Can the set S be partitioned as S = AuB with A Pi B = 0, so that XaeA a = ZfceB b. 


The first of the three problems sounds easy, and it is. You just consider the numbers 
in the set one by one and test to see if any of them is 83, 172. You can stop if you ever 
find this number and report that the answer is yes. If you return a no answer, then 
you will have to have read every number in the list. Either way, you halt with a correct 
answer to the question having done at most 10, 000 tests, and even the most modest 
netbook can do this in a heartbeat. And if the list is expanded to 1, 000, 000 integers, 
all at most a billion, you can still do it easily. More generally, if you're given a set S of 
n numbers and an integer x with the question "Is x a member of ST' , you can answer 
this question in n steps, with each step an operation of testing a number in S to see if 
it is exactly equal to n. So the running time of this algorithm is proportional to n, with 
the constant depending on the amount of time it takes a computer to perform the basic 
operation of asking whether a particular integer is equal to the target value. 

The second of the three problems is a bit more challenging. Now it seems that we 
must consider the 3-element subsets of a set of size 10, 000. There are C(10, 000, 3) such 
sets. On the one hand, testing three numbers to see if their sum is 143, 297 is very easy, 
but there are lots and lots of sets to test. Note that C(10, 000, 3) = 166, 616, 670, 000, 
and not too many computers will handle this many operations. Moreover, if the list is 
expanded to a million numbers, then we have more than 10 17 triples to test, and that's 
off the table with today's hardware. 

Nevertheless, we can consider the general case. We are given a set S of n integers 
and a number x. Then we are asked whether there are three integers in S whose sum 
is x. The algorithm we have described would have running time proportional to n 3 , 
where the constant of proportionality depends on the time it takes to test a triple of 
numbers to see if there sum is x. Of course, this depends in turn on just how large the 
integer x and the integers in S can be. 

The third of the three problems is different. First, it seems to be much harder. There 
are 2" _1 complementary pairs of subsets of a set of size n, and one of these involves 
the empty set and the entire set. But that leaves 2"~ 1 - 1 pairs to test. Each of these 
tests is not all that tough. A netbook can easily report whether a two subsets have the 
same sum, even when the two sets form a partition of a set of size 10, 000, but there 
are approximately lO 3000 partitions to test and no piece of hardware on the planet will 
touch that assignment. And if we go up to a set of size 1, 000, 000, then the combined 
computing power of all the machines on earth won't get the job done. 

In this setting, we have an algorithm, namely testing all partitions, but it is totally 
unworkable for n element sets when n is large since it has running time proportional 
to 2”. 
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4.2.2 Certificates 

Each of the three problems we have posed is in the form of a "yes /no" question. A 
"yes" answer to any of the three can be justified by providing a certificate that can be 
checked efficiently For example, if you answer the first question with a yes, then you 
might provide the additional information that you will find 83, 172 as the integer on 
line 584 in the input file. Of course, you could also provide the source code for the 
computer program, and let a referee run the entire procedure. 

Similarly, if you answer the second question with a yes, then you could specify the 
three numbers and specify where in the input file they are located. An impartial referee 
could then verify, if it mattered, that the sum of the three integers was really 143, 297 
and that they were located at the specified places in the input file. Alternatively, you 
could again provide the source code which would require the referee to test all triples 
and verify that there is one that works. 

Likewise, a yes for the third question admits a modest size certificate. You need only 
specify the elements of the subset A. The referee, who is equipped with a computer, 
can (a) check to see that all numbers in A belong to S ; (b) form a list of the subset B 
consisting of those integers in S that do not belong to A; and (c) compute the sums 
of the integers in A and the integers in B and verify that the two sums are equal. But 
in this case, you would not provide source code for the algorithm, as there does not 
appear (at least nothing in our discussion thus far provides one) to be a reasonable 
strategy for deciding this problem when the problem size is large. 

Now let's consider the situation with a "no" answer. When the answer to the first 
question is no, the certificate can again be a computer program that will enable the 
referee to consider all the elements of S and be satisfied that the number in question 
is not present. A similar remark holds for the second question, i.e., the program is the 
certificate. 

But the situation with the third question is again very different. Now we can't say to 
the referee "We checked all the possibilities and none of them worked." This could not 
possibly be a true statement. And we have no computer program that can be run by 
us or by the referee. The best we could say is that we tried to find a suitable partition 
and were unable to do so. As a result, we don't know what the correct answer to the 
question actually is. 

4.2.3 Operations 

Many of the algorithms we develop in this book, as well as many of the computer pro- 
grams that result from these algorithms involve basic steps that are called operations. 
The meaning of the word operation is intentionally left as an imprecise notion. An 
operation might be just comparing two integers to see if they are equal; it might be up- 
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dating the value of a variable x and replacing it by x 2 - 3 x + 7; and it might be checking 
whether two set sums are equal. In the third instance, we would typically limit the size 
of the two subsets as well as the integers in them. As a consequence, we want to be 
able to say that there is some constant c so that an operation can be carried out in time 
at most c on a computer. Different computers yield different values of c, but that is a 
discrepancy which we can safely ignore. 

4.2.4 Input Size 

Problems come in various sizes. The three problems we have discussed in this chapter 
have the same input size. Roughly speaking this size is 10, 000 blocks, with each block 
able to hold an integer of size at most 100, 000. In this text, we will say that the input 
size of this problem is n = 10, 000, and in some sense ignoring the question of the size 
of the integers in the set. There are obvious limitations to this approach. We could be 
given a set S of size 1 and a candidate element x and be asked whether x belongs to 
S. Now suppose that x is a bit string the size of a typical compact disk, i.e., some 700 
megabytes in length. Just reading the single entry in S to see if it's exactly x will take 
some time. 

In a similar vein, consider the problem of determining whether a file x is located 
anywhere in the directory structure under y in a unix file system. If you go on the 
basis of name only, then this may be relatively easy. But what if you want to be sure 
that an exact copy of x is present? Now it is much more challenging. 


4.3 The Big “Oh” and Little “Oh” Notations 

Let / : N — > R and i] : N — » R be functions. We write / = O(q), and say / 
is "Big Oh" of g, when there is a constant c and an integer no so that f(n) < cg{n) 
whenever n > Hq. Although this notation has a long history, we can provide a quite 
modern justification. If / and g both describe the number of operations required for 
two algorithms given input size n, then the meaning of / = O(g) is that / is no harder 
than g when the problem size is large. 

We are particularly interested in comparing functions against certain natural bench- 
marks, e.g., log log n, log n, yfn, n a where a < 1, n, n 2 , n 3 , n c where c > 1 is a constant, 
n lo g«, 2 n , n\, 2” 2 , etc. 

For example, in Subsection 3.5.2 we learned that there are sorting algorithms with 
running time 0(n log n) where n is the number of integers to be sorted. As a second 
example, we will learn that we can find all shortest paths in an oriented graph on n 
vertices with non-negative weights on edges with an algorithm having running time 
0(n 2 ). At the other extreme, no one knows whether there is a constant c and an algo- 
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rithm for determining whether the chromatic number of a graph is at most three which 
has running time 0(n c ). 

It is important to remember that when we write / = O(g), we are implying in some 
sense that / is no bigger than g, but it may in fact be much smaller. By contrast, there 
will be times when we really know that one function dominates another. And we have 
a second kind of notation to capture this relationship. 

Let / : N — > R and g : N — > R be functions with /(«) > 0 and g{n) > 0 for all 
n. We write / = o(g), and say that / is "Little oh" of g, when lim n _>oo f(n)/g(n) = 0. 
For example In n = o(n 2 ); n a = o(n^) whenever 0 < a < p; and n 100 = o(c'') for every 
c > 1. In particular, we write /(«) = o(l) when lim„_>oo f(n) = 0. 


4.4 Exact Versus Approximate 

Many combinatorial problems admit "exact" solutions, and in these cases, we will usu- 
ally try hard to find them. The Erdos / Szekeres Theorem 4.2 from earlier in this chapter 
is a good example of an "exact" result 1 . By this statement, we mean that for each pair m 
and n of positive integers, there is a sequence of inn distinct real numbers that has nei- 
ther an increasing subsequence of size m + 1 nor a decreasing subsequence of size n + 1 . 
To see this, consider the sequence a defined as follows: For each i = 1,2, ... , m, let 
B, = {j + (m - 1 )z : 1 < j < n}. Note that each B, is a block of n consecutive integers. 
Then define a permutation a of the first mn integers by setting a < p if there exist 
distinct integers i\ and ij so that a £ B I] and (i e B l2 . Also, for each i = 1,2, ... , m, set 
a < in o when 1 + (m - l)z < |S < a < n + (m - 1 )z. Clearly, any increasing sub- 
sequence of a contains at most one member from each block, so o has no increasing 
sequence of size m = 1. On the other hand, any decreasing sequence in o is contained 
in a single block, so o has no decreasing sequence of size n + 1. 

As another example of an exact solution, the number of integer solutions to x\ + 
X 2 + ■ ■ ■ x r = n with Xi > 0 for i — 1,2, . . . , r is exactly C(n - 1, r - 1). On the other 
hand, nothing we have discussed thus far allows us to provide an exact solution for 
the number of partitions of an integer n . 

4.4.1 Approximate and Asymptotic Solutions 

Here's an example of a famous problem that we can only discuss in terms of approx- 
imate solutions, at least when the input size is suitably large. For an integer n, let 
n(n) denote the number of primes among the first n positive integers. For example, 
tt( 12) = 5 since 2, 3, 5, 7 and 11 are primes. The exact value of n(n) is known when 

1 Exact results are also called "best possible", "sharp" or "tight." 
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n < 10 23 , and in fact: 


n(10 23 ) = 1,925,320,391,606,803,968,923 

Qn the other hand, you might ask whether n(n ) tends to infinity as n grows larger 
and larger. The answer is yes, and here's a simple and quite classic argument. Suppose 
to the contrary that there were only k primes, where A: is a positive integer. Suppose 
these k primes are listed in increasing order as p\ < p 2 < ■ ■ ■ < Pk, and consider the 
number n = 1 4- p i pj ■ ■ ■ pk • Then n is not divisible by any of these primes, and it is 
larger than pk, which implies that n is either a prime number larger than pk or divisible 
by a prime number larger than pk- 

So we know that lim„_>oo n(n) = oo. In a situation like this, mathematicians typically 
want to know more about how fast n(n) goes to infinity. Some functions go to infinity 
"slowly", such as log n or log log n . Some go to infinity quickly, like 2” , n ! or 2 2 . Since 
n(n) < n, it can't go to infinity as fast as these last three functions, but it might go 
infinity like log n or maybe xfn. 

Qn the basis of computational results (done by hand, long before there were com- 
puters), Legendre conjectured in 1796 that n(n) goes to infinity like n / In n . To be more 
precise, he conjectured that 

, n(n)\nn 
lim = 1. 

n— >oo fl 

In 1896, exactly one hundred years after Legendre's conjecture, Hadamard and de 
la Vallee-Poussin independently published proofs of the conjecture, using techniques 
whose roots are in the Riemann's pioneering work in complex analysis. This result, 
now known simply as the Prime Number Theorem, continues to this day to be much 
studied topic at the boundary of analysis and number theory. 

4.4.2 Polynomial Time Algorithms 

Throughout this text, we will place considerable emphasis on problems for which a 
certificate can be found in polynomial time. This refers to problems for which there is 
some constant c > 0 so that there is an algorithm TA for solving the problem which has 
running time 0(n c ) where n is the input size. The symbol P is suggestive of polynomial. 

4.4.3 P = NP7 

Perhaps the most famous question at the boundary of combinatorial mathematics, the- 
oretical computer science and mathematical logic is the notoriously challenging ques- 
tion of deciding whether P is the same as NP . This problem has the shorthand form: 
P = NP1 Here, we present a brief informal discussion of this problem. 
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First, we have already introduced the class P consisting of all yes-no combinatorial 
problems which admit polynomial time algorithms. The first two problems discussed 
in this chapter belong to P since they can be solved with algorithms that have running 
time 0(n ) and O(ir’), respectively Also, determining whether a graph is 2-colorable 
and whether it is connected both admit polynomial time algorithms. 

We should emphasize that it may be very difficult to determine whether a problem 
belongs to class P or not. For example, we don't see how to give a fast algorithm for 
solving the third problem (subset sum), but that doesn't mean that there isn't one. 
Maybe we all need to study harder! 

Setting that issue aside for the moment, the class NP consists of yes-no problems for 
which there is a certificate for a yes answer whose correctness can be verified in poly- 
nomial time. More formally, this is called the class of nondeterministic polynomial 
time problems. Our third problem definitely belongs to this class. 

The famous question is to determine whether the two classes are the same. Evi- 
dently, any problem belonging to P also belongs to NP, i.e, P C NP, but are they 
equal? It seems difficult to believe that there is a polynomial time algorithm for set- 
tling the third problem (the subset sum problem), and no one has come close to settling 
this issue. But if you get a good idea, be sure to discuss it with one or both authors of 
this text before you go public with your news. If it turns out that you are right, you are 
certain to treasure a photo opportunity with yours truly. 


4.5 Discussion 

Carlos, Dave and Yolanda were fascinated by the discussion on complexity. Zori was 
less enthusiastic but even she sensed that the question of which problems could be 
solved quickly had practical implications. She could even predict that people could 
earn a nice income solving problems faster and more accurately than their competition. 

Bob remarked, "I'm not sure I understand what's being talked about here. I don't see 
why it can't be the case that all problems can be solved. Maybe we just don't know how 
to do it." Xing said, "Any finite problem can be solved. There is always a way to list all 
the possibilities, compare them one by one and take the best one as the answer." Alice 
joined in, "Well, a problem might take a long time just because it is big. For example, 
suppose you are given two dvd's, each completely full with the data for a large integer. 
Flow are you possibly going to multiply them together, even with a large computer 
and fancy software." Carlos then offered, "But I think there are really hard problems 
that any algorithm will take a long time to solve and not just because the input size is 
large. At this point, I don't know how to formulate such a problem but I suspect that 
they exist." 
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4.6 Exercises 

1. Suppose you are given a list of n integers, each of size at most 1 00/? . How many 
operations would it take you to do the following tasks (in answering these questions, 
we are interested primarily in whether it will take log n , yfn, n, n 2 , n 3 , 2”, . . . steps. In 
other words, ignore multiplicative constants.): 

(a) Determine if the number 2n + 7 is in the list. 

(b) Determine if there are two numbers in the list whose sum is 2 n + 7. 

(c) Determine if there are two numbers in the list whose product is 2 n+7 (This one is 
more subtle than it might appear! It may be to your advantage to sort the integers 
in the list). 

(d) Determine if there is a number i for which all the numbers in the list are between 
i and i + 2n + 7. 

(e) Determine the longest sequence of consecutive integers belonging to the list. 

(f) Determine the number of primes in the list. 

(g) Determine whether there are three integers x, y and z from the list so that x + y = 
z. 

(h) Determine whether there are three integers x, y and z from the list so that x 2 +y 2 = 
z 2 . 

(i) Determine whether there are three integers x, y and z from the list so that xy = z. 

(j) Determine whether there are three integers x, y and z from the list so that x XJ = z. 

(k) Determine whether there are two integers x and y from the list so that x y is a 
prime. 

(l) Determine the longest arithmetic progression in the list (a sequence («i, « 2 , • • ■ / ) 

is an arithmetic progression when there is a constant d + 0 so that a l+ \ = fl, + d, 
for each i = 1,2, . . . , t - 1). 

(m) Determine the number of distinct sums that can be formed from members of the 
list (arbitrarily many integers from the list are allowed to be terms in the sum). 

(n) Determine the number of distinct products that can be formed from members 
of the list (arbitrarily many integers from the list are allowed to be factors in the 
product). 

(o) Determine for which integers m, the list contains at least 10% of the integers from 

{1,2 

2 . If you have to put n + 1 pigeons into n holes, you have to put two pigeons into the 

same hole. What happens if you have to put mn +1 pigeons into n holes? 


67 



Chapter 4 Combinatorial Basics 


3. Consider the set X = {1,2,3,4,51 and suppose you have two holes. Also suppose 
that you have 10 pigeons: the 2-element subsets of X. Can you put these 10 pigeons 
into the two holes in a way that there is no 3-element subset S = {a,b,c} C X for 
which all pigeons from S go in the same hole? Then answer the same question if X = 
{1,2, 3,4, 5, 6} with 15 = C(6, 2) pigeons. 

4. Let n = 10,000. Suppose a friend tells you that he has a secret family of subsets 
of {1, 2 , ,n}, and if you guess it correctly, he will give you one million dollars. You 
think you know the family of subsets he has in mind and it contains exactly half the 
subsets, i.e., the family has 2"" 1 subsets. Discuss how you can share your hunch with 
your friend in an effort to win the prize. 

5. Let N denote the set of positive integers. When f : N — » N is a function, let £(/) be 
the function defined by £(/)(«) = 2^ n \ What is E 5 (n 2 )? 
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Graph Theory 

In Example 1.5, we discussed the problem of assigning frequencies to radio stations in 
the situation where stations within 200 miles of each other must broadcast on distinct 
frequencies. Clearly we would like to use the smallest number of frequencies possible 
for a given layouts of transmitters, but how can we determine what that number is? 

Suppose three new homes are being built and each of them must be provided with 
utility connections. The utilities in question are water, electricity, and natural gas. Each 
provider needs a direct line from their terminal to each house (the line can zig-zag all it 
wants, but it must go from the terminal to the house without passing through another 
provider's terminal or another house en route), and the three providers all wish to 
bury their lines exactly four feet below ground. Can they do this successfully without 
the lines crossing? 

These are just two of many, many examples where the discrete structure known as a 
graph can serve as an enlightening mathematical model. Graphs are perhaps the most 
basic and widely studied combinatorial structure, and they are prominently featured 
in this text. Many of the concepts we will study, while presented in a more abstract 
mathematical sense, have their origins in applications of graphs as models for real- 
world problems. 


5.1 Basic Notation and Terminology for Graphs 

A graph G is a pair (V, E) where V is a set (almost always finite) and £ is a set of 2- 
element subsets of V . Elements of V are called vertices and elements of £ are called 
edges. We call V the vertex set of G and £ is the edge set. For convenience, it is 
customary to abbreviate the edge { x , y} as just xy. Remember though that xy £ E 
means exactly the same as yx e £. If x and y are distinct vertices from V , x and y are 
adjacent when xy e £; otherwise, we say they are non-adjacent. We say the edge xy 
is incident to the vertices x and y. 

For example, we could define a graph G = (V, £) with vertex set V = {a, b, c, d, e} 
and edge set £ = {{a, b } , {c, d}, {a, d } } . Notice that no edge is incident to e, which is 
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perfectly permissible based on our definition. It is quite common to identify a graph 
with a visualization in which we draw a point for each vertex and a line connecting two 
vertices if they are adjacent. The graph G we've just defined is shown in Figure 5.1. It's 
important to remember that while a drawing of a graph is a helpful too, it is not the 
same as the graph. We could draw G in any of several different ways without changing 
what it is as a graph. 


a 



Figure 5 . 1 : A graph on 5 vertices 


As is often the case in science and mathematics, different authors use slightly dif- 
ferent notation and terminology for graphs. As an example, some use nodes and arcs 
rather than vertices and edges. Others refer to vertices as points and in this case, they 
often refer to lines rather than edges. We will try to stick to vertices and edges but con- 
fess that we may occasionally lapse into referring to vertices as points. Also, following 
the patterns of many others, we will also say that adjacent vertices are neighbors. And 
we will use the more or less standard terminology that the neighborhood of a vertex 
x is the set of vertices adjacent to x. Thus, using the graph G we have depicted in 
Figure 5.1, vertices d and a are neighbors, and the neighborhood of d is {a, c} while 
the neighborhood of e is the empty set. Also, the degree of a vertex v in a graph G, 
denoted deg G (u)/ is then the number of vertices in its neighborhood, or equivalently, 
the number of edges incident to it. For example, we have deg G (d) = deg G (a) = 2, 
deg G (c) = d eg c ( b ) = 1, and deg G (e) = 0. If the graph being discussed is clear from 
context, it is not uncommon to omit the subscript and simply write deg(z') for the de- 
gree of v. 

When G = (V, E) and H = (W, F) are graphs, we say H is a subgraph of G when 
W c V and F c E. We say H is an induced subgraph when W c V and F = {xy e E : 
x,y e W}. In other words, an induced subgraph is defined completely by its vertex 
set and the original graph G. We say H is a spanning subgraph when W = V. In 
Figure 5.2, we show a graph, a subgraph and an induced subgraph. Neither of these 
subgraphs is a spanning subgraph. 

A graph G = (V, E) is called a complete graph when xy is an edge in G for every 
distinct pair x, y e V. Conversely, G is an independent graph if xy i £, for every 
distinct pair x, y e V . It is customary to denote a complete graph on n vertices by K„ 
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Figure 5.2: A Graph, a Subgraph and an Induced Subgraph 


o 


Ki 



and an independent graph on n vertices by I„ . In Figure 5.3, we show the complete 
graphs with at most 5 vertices. 


A sequence (xi, X 2 , . . . , x„) of vertices in a graph G = ( V , E ) is called a walk when 
Xj-Xf+i is an edge for each i = 1,2,..., n - 1. Note that the vertices in a walk need not 
be distinct. On the other hand, if the vertices are distinct, then the sequence is called a 
path, and often to emphasize where a path starts and ends, we will say that a sequence 
(xi, X 2 , • ■ ■ , x„) of distinct vertices is a path from X\ to x„ in G. Similarly, when n > 3, a 
path (xi, X 2 , . . . , x n ) of n distinct vertices is called a cycle when xix„ is also an edge in 
G. It is customary to denote a path on n vertices by P„ , while C„ denotes a cycle on n 
vertices. The length of a path or a cycle is the number of edges it contains. Therefore, 
the length of P„ is n - 1 and the length of C„ is n. In Figure 5.4, we show the paths of 
length at most 4, and in Figure 5.5, we show the cycles of length at most 5. 
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Pi p 2 p 3 p 4 

Figure 5.4: Short paths 




Figure 5.5: Small cycles 


If G = ( V,E ) and H = ( W,F ) are graphs, we say G is isomorphic to H and write 
G = H when there exists a bijection / : V * W so that x is adjacent to y in G if 

onto 

and only if f(x ) is adjacent to f(y) in H. Often writers will say that G "contains" H 
when there is a subgraph of G which is isomorphic to H. In particular, it is customary 
to say that G contains the cycle C„ (same for P„ and K„ ) when G contains a subgraph 
isomorphic to C„. The graphs in Figure 5.6 are isomorphic. An isomorphism between 
these graphs is given by 

/(«) = 5, f(b) = 3, /(c) = 1, /(d) = 6, f(e) = 2, f(h) = 4. 

4 
5 

e 

Figure 5.6: A pair of isomorphic graphs 




On the other hand, the graphs shown in Figure 5.7 are not isomorphic, even though 
they have the same number of vertices and the same number of edges. Can you tell 
why? 
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Figure 5.7: A pair of nonisomorphic graphs 


A graph G is connected when there is a path from x to y in G, for every x, y e V; 
otherwise, we say G is disconnected. The graph of Figure 5.1 is disconnected (a suffi- 
cient justification for this is that there is no path from e to c), while those in Figure 5.6 
are connected. If G is disconnected, we call a maximal connected subgraph of G a 
component. By this we mean that a subgraph H of G is a component of G provided 
that there does not exist a connected subgraph H' of G such that H is a subgraph of 
H'. 

A graph is acyclic when it does not contain any cycle on three or more vertices. 
Acyclic graphs are also called forests. A connected acyclic graph is called a tree. When 
G = (V, E ) is a connected graph, a subgraph H = ( W, F) of G is called a spanning tree 
if H is both a spanning subgraph of G and a tree. In Figure 5.8, we show a graph and 
one of its spanning trees. We will return to the subject of spanning trees in Chapter 12. 




Figure 5.8: A Graph and a Spanning Tree 

The following theorem is very elementary, and some authors refer to it as the "first 
theorem of graph theory". Flowever, this basic result can be surprisingly useful. 
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Theorem 5.9. Let deg G (c) denote the degree of vertex v in graph G = ( V, , E). Then 

J^deg G (v) = 2\E\. (5.1.1) 

V€V 

Proof. We consider how many times an edge e = vw £ E contributes to each side of 
(5.1.1). The deg G (x) and deg G (y) terms on the left hand side each count e once, so 
e is counted twice on that side. On the right hand side, e is clearly counted twice. 
Therefore, we have the equality claimed. □ 

Corollary 5.10. For any graph , the number of vertices of odd degree is even. 

We will return to the topic of trees later, but before moving on, let us prove one 
elementary proposition about trees. First, a leaf in a tree T is a vertex v with deg T (u) = 
1. 

Proposition 5.11. Every tree on n > 2 vertices has at least two leaves. 

Proof. Our proof is by induction on n . For n = 2, there is precisely one tree, which is 
isomorphic to K 2 . Both vertices in this graph are leaves, so the proposition holds for 
n =2. Now suppose that for some integer m > 2, every tree on at most m vertices has 
at least two leaves and let T = (V, E) be a tree on m + 1 vertices. Pick an edge e e E and 
form a new graph T' = (V', £') by deleting e from T. That is, V' = V and E' = E - {e}. 

Now since T' does not contain a path from one endpoint of e to its other endpoint, 

T' is not connected, fiowever, deleting an edge cannot create a cycle, so T' is a forest. 
Furthermore, it has precisely two components, each of which is a tree with at most m 
vertices. If each component has at least two vertices, then by induction, each has at 
least two leaves. In the worst case scenario, two of these leaves are the endpoints of e, 
so at least two of the vertices are leaves in T, too. If each component of T' has only one 
vertex, then T = K 2 , which has two leaves. If exactly one of the components has only 
one vertex, then it must be a leaf in T. Thus, applying the inductive hypothesis to the 
other component ensures that there is a second leaf in T. □ 


5.2 Multigraphs: Loops and Multiple Edges 

Consider a graph in which the vertices represent cities and the edges represent high- 
ways. Certain pairs of cities are joined by an edge while other pairs are not. The graph 
may or may not be connected (although a disconnected graph is likely to result in dis- 
gruntled commuters). TTowever, certain aspects of real highway networks are not cap- 
tured by this model. First, between two nearby cities, there can actually be several 
interconnecting highways, and traveling on one of them is fundamentally different 
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from traveling on another. This leads to the concept of multiple edges, i.e., allowing 
for more than one edge between two adjacent vertices. Also, we could have a highway 
which leaves a city, goes through the nearby countryside and the returns to the same 
city where it originated. This leads to the concept of a loop, i.e., an edge with both 
end points being the same vertex. Also, we can allow for more than one loop with the 
same end point. 

Accordingly, authors frequently lead off a discussion on a graph theory topic with a 
sentence or two like: 

1. In this paper, all graphs will be simple, i.e., we will not allow loops or multiple 
edges. 

2. In this paper, graphs can have loops and multiple edges. 

The terminology is far from standard, but in this text, a graph will always be a simple 
graph, i.e., no loops or multiple edges. When we want to allow for loops and multiple 
edges, we will use the term multigraph. This suggests the question of what we would 
call a graph if it is allowed to have loops but not multiple edges, or if multiple edges are 
allowed but not loops. If we really needed to talk about such graphs, then the English 
language comes to our rescue, and we just state the restriction explicitly! 


5.3 Eulerian and Hamiltonian Graphs 

Graph theory is an area of mathematics that has found many applications in a variety 
of disciplines. Throughout this text, we will encounter a number of them. However, 
graph theory traces its origins to a problem in Konigsberg, Prussia (now Kaliningrad, 
Russia) nearly three centuries ago. The river Pregel passes through the city, and there 
are two large islands in the middle of the channel. These islands were connected to 
the mainland by seven bridges as indicated in Figure 5.12. It is said that the citizens of 
Konigsberg often wondered if it was possible for one to leave his home, walk through 
the city in such a way that he crossed each bridge precisely one time, and end up at 
home again. Leonhard Euler settled this problem in 1736 by using graph theory in the 
form of Theorem 5.13. 

Let G be a graph without isolated vertices. We say that G is eulerian provided that 
there is a sequence (xo, Xi, X 2 , . . . , x f ) of vertices from G, with repetition allowed, so 
that 

1. x 0 = Xf, 

2. for every i = 0, 1, . . . t - 1, x,x !+ i is an edge of G; 
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3. for every edge e e E, there is a unique integer i with 0 < i < t for which e = 
XiXi+l. 

When G is eulerian, a sequence satisfying these three conditions is called an eulerian 
circuit. A sequence of vertices ( Xo , X\, , X/) is called a circuit when it satisfies only 
the first two of these conditions. Note that a sequence consisting of a single vertex is a 
circuit. Before proceeding to Euler's elegant characterization of eulerian graphs, let's 
use SageMath to generate some graphs that are and are not eulerian. 

Run the code below. It will execute until it finds a graph G that is eulerian. The 
output that will be produced is a list of the degrees of the vertices of the graph G 
followed by a drawing of G. 

vertices = 13 
edges = 28 

g = graphs . RandomGNM ( vert ices , edges ) 

while (not g . is_eulerian () or not g . is_connected () ) : 

g = graphs . RandomGNM (vertices , edges) 
print g. degree_sequence() 
g . show () 

We encourage you to evaluate the run the code above multiple times, even changing 
the number of vertices and edges. If it seems to be running a log time, it may be that 
you have made the number of edges too small, so try increasing it a bit. Do you notice 
anything about the degrees of the vertices in the graphs produced? 

Now let's try to find a graph H that is not eulerian. Again, the output is the list of 
degrees of H followed by a drawing of H. 

vertices = 15 
edges = 25 

g = graphs . RandomGNM ( vert ices , edges ) 
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while (g . is_eulerian () or not g. is_connected () ) : 

g = graphs . RandomGNM (vertices , edges) 
print g. degree_sequence () 
g . show () 

One thing you probably noticed in running this second block of code is that it tended 
to come back much faster than the first. That would suggest that the non-eulerian 
graphs outnumber the eulerian graphs. Did you notice anything different about the 
degrees of the vertices in these graphs compared to the ones that were eulerian? 

The following elementary theorem completely characterizes eulerian graphs. Its 
proof gives an algorithm that is easily implemented. 

Theorem 5.13. A graph G is eulerian if and only if it is connected and every vertex has even 
degree. 

Proof. Clearly, an eulerian graph must be connected. Also, if (x'o, X\, ... , x t ) is an eule- 
rian circuit in G, then for each i = 0, 1, . . . , t - 1, we can view the edge x,x I+ i as exiting 
xi and entering x l+ \ . The degree of every vertex must be even, since for each vertex x, 
the number of edges exiting x equals the number of edges entering x. Furthermore, 
each edge incident with x either exits from x or enters x. 

We now describe a deterministic process that will either (a) find an eulerian circuit, 
(b) show that the graph is disconnected, or (c) find a vertex of odd degree. The de- 
scription is simplified by assuming that the vertices in G have been labelled with the 
positive integers 1,2, ... ,n, where n is the number of vertices in G. Furthermore, we 
take xq = 1. 

We launch our algorithm with a trivial circuit C consisting of the vertex Xq = (1). 
Thereafter suppose that we have a partial circuit C defined by (xq, X\, . . . , x t ) with Xq = 
Xt = 1. The edges of the form x t x l+ ] have been traversed, while the remaining edges in 
G (if any) have not. If the third condition for an euler circuit is satisfied, we are done, 
so we assume it does not hold. 

We then choose the least integer i for which there is an edge incident with x, that has 
not already been traversed. If there is no such integer, since there are edges that have 
not yet been traversed, then we have discovered that the graph is disconnected. So we 
may assume that the integer i exists. Set uq = Xj. We define a sequence (uq, u\, . . . , u s ) 
recursively. If j > 0, set 

Nj = {y : u j y is an edge in G and has not yet been traversed.} 

If Nj + 0, we take Uj+ \ as the least positive integer in Nj. If Nj = tit, then j > 1 and we 
take s = j and halt this subroutine. 

When the subroutine halts, we consider two cases. If uq + u s , then uq and u s are 
vertices of odd degree in G. So we are left to consider the case where Uq = u s = x t . 
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In this case, we simply expand our original sequence {xq, x\, . . . , x t ) by replacing the 
integer Xj by the sequence (uq, U \, . . . , u s ). □ 


As an example, consider the graph G shown in Figure 5.14. Evidently, this graph is 
connected and all vertices have even degree. Here is the sequence of circuits starting 
with the trivial circuit C consisting only of the vertex 1. 


C = (l) 

= (1,2,4, 3,1) start next from 2 
= (1,2, 5, 8, 2,4, 3, 1) start next from 4 
= (1,2,5, 8, 2,4, 6, 7, 4, 9, 6, 10,4,3, 1) start next from 7 
= (1,2,5,8,2,4,6,7,9,11,7,4,9,6,10,4,3,1) Done!! 



Figure 5.14: An Eulerian Graph 


You should note that Theorem 5.13 holds for loopless graphs in which multiple edges 
are allowed. Euler used his theorem to show that the multigraph of Konigsberg shown 
in Figure 5.15, in which each land mass is a vertex and each bridge is an edge, is not 
eulerian, and thus the citizens could not find the route they desired. (Note that in 
Figure 5.15 there are multiple edges between the same pair of vertices.) 
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Figure 5.15: The multigraph of Konigsberg's bridges 


A graph G = ( V , E) is said to be hamiltonian if there exists a sequence (x \ , X 2 , . . . ,x n ) 
so that 

1. every vertex of G appears exactly once in the sequence; 

2. x\x n is an edge of G; and 

3. for each i = 1, 2, . . . , n — 1, x;x;+i is an edge in G. 

Such a sequence of vertices is called a hamiltonian cycle. 

The first graph shown in Figure 5.16 both eulerian and hamiltonian. The second is 
hamiltonian but not eulerian. 




G H 

Figure 5.16: Eulerian and Hamiltonian Graphs 

In Figure 5.17, we show a famous graph known as the Petersen graph. It is not hamil- 
tonian. 
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Unlike the situation with eulerian circuits, there is no known method for quickly de- 
termining whether a graph is hamiltonian. However, there are a number of interesting 
conditions which are sufficient. Here is one quite well known example, due to Dirac. 

Theorem 5.18. If G is a graph on n vertices and each vertex in G has at least \ j~\ neighbors, 
then G is hamiltonian. 

Proof. Suppose the theorem fails and let n be the least positive integer for which there 
exists a graph Gon« vertices so that each vertex in G has at least [" n /2"| neighbors, yet 
there is no hamiltonian cycle in G. Clearly, n > 4. 

Now let t be the largest integer for which G has a path P = (x\, xi, . . . , x t ) on t 
vertices. Clearly all neighbors of both x\ and x t appear on this path. By the pigeon 
hole principle, there is some integer i with 1 < i < t so that X\ x, + i and XjX t are edges 
in G. However, this implies that 

C — (Xl, X2, X3, . . . , Xj, Xt, Xt— 1, Xt- 2, ■ . . , xt+f) 

is a cycle of length t in G. In turn, this requires \n/ 2] < t < n. But if y is any vertex 
not on the cycle, then y must have a neighbor on C, which implies that G has a path 
on t + 1 vertices. The contradiction completes the proof. □ 

5.4 Graph Coloring 

Let's return now to the subject of Example 1.5, assigning frequencies to radio stations 
so that they don't interfere. The first thing that we will need to do is to turn the map 
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of radio stations into a suitable graph, which should be pretty natural at this juncture. 
We define a graph G = (V,E) in which V is the set of radio stations and xy e E if 
and only if radio station x and radio station y are within 200 miles of each other. With 
this as our model, then we need to assign different frequencies to two stations if their 
corresponding vertices are joined by an edge. This leads us to our next topic, coloring 
graphs. 

When G = (V, E) is a graph and C is a set of elements called colors, a proper coloring 
of G is a function <p : V — » C such that if <p(x) + (p(y) whenever xy is an edge in G. The 
least t for which G has a proper coloring using a set C of t colors is called the chromatic 
number of G and is denoted ,\'(G) . In Figure 5.19, we show a proper coloring of a graph 
using 5 colors. Now we can see that our radio frequency assignment problem is the 
much-studied question of finding the chromatic number of an appropriate graph. 



Figure 5.19: A proper coloring using 5 colors 


Discussion 5.20. Everyone agrees that the graph G in Figure 5.19 has chromatic num- 
ber at most 5. However, there's a bit of debate going on about if ,y(G) = 5. Bob figures 
the authors would not have used five colors if they didn't need to. Carlos says he's 
glad they're having the discussion, since all having a proper coloring does is provide 
them with an upper bound on y(G). Bob sees that the graph has a vertex of degree 5 
and claims that must mean y(G) = 5. Alice groans and draws a graph with 101 ver- 
tices, one of which has degree 100, but with chromatic number 2. Bob is shocked, but 
agrees with her. Xing wonders if the fact that the graph does not contain a K 3 has any 
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bearing on the chromatic number. Dave's in a hurry to get to the gym, but on his way 
out the door he says they can get a proper 4-coloring pretty easily, so ,y(G) < 4. The 
rest decide it's time to keep reading. 

• What graph did Alice draw that shocked Bob? 

• What changes did Dave make to the coloring in Figure 5.19 to get a proper col- 
oring using four colors? 

5.4.1 Bipartite Graphs 

A graph G = (V, E ) with ,y(G) < 2 is called a 2-colorable graph. A couple of minutes 
of reflection should convince you that for n > 2, the cycle C 2 n with 2 n vertices is 2- 
colorable. On the other hand, C 3 = K 3 is clearly not 2-colorable. Furthermore, no odd 
cycle C 2 H +1 for n > 1 is 2-colorable. It turns out that the property of containing an 
odd cycle is the only impediment to being 2-colorable, which means that recognizing 
2-colorable graphs is easy, as the following theorem shows. 

Theorem 5.21. A graph is 2-colorable if and only if it does not contain an odd cycle. 

Proof. Let G = (V, E) be a 2-colorable graph whose coloring function partitions V as 
AUB. Since there are no edges between vertices on the same side of the partition, any 
cycle in G must alternate vertices between A and B. In order to complete the cycle, 
therefore, the number of vertices in the cycle from A must be the same as the number 
from B, implying that the cycle has even length. 

Now suppose that G does not contain an odd cycle. Note that we may assume that 
G is connected, as each component may be colored individually. The distance d(u, v ) 
between vertices u, v e V is the length of a shortest path from n to v, and of course 
d(u,u) = 0. Fix a vertex vq e V and define 

A = {v eV \ d(uo, v ) is even} and B = {v e V: d(v 0 , v) is odd}. 

We claim that coloring the vertices of A with color 1 and the vertices of B with color 
2 is a proper coloring, suppose not. Then without loss of generality, there are vertices 
x,y e A such that xy e E. Since x, y e A, d( vq, x) and d(v 0 , y) are both even. Let 

vo,xi,x 2 ,...,x n = x 


and 


v o> yi, yi, ■ ■ ■ ,ym - y 

be shortest paths from vo to x and y, respectively. If x\ + y ; for all 1 < i < n and 
1 < j < m, then since m and n are both even. 


vo, X\, X'l , . . . , x n — x, y — y m , y m —\, . . . , y^, y\, ^0 
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is an odd cycle in G, which is a contradiction. Thus, there must be i, j such that x, = j 
and we may take i, j as large as possible. (That is, after x, = y,, the two paths do not 
intersect again.) Thus, 

Xi, %i+l/ ■ ■ ■ / Xn — X ,\j — l/ni/ }/m-l/ ■■■/}/] = Xi 

is a cycle in G. How many vertices are there in this cycle? A quick count shows that it 
has 


n - (i - 1 ) + m - (j - 1 ) - 1 = n + m - ( i + j) + 1 


vertices. We know that n and m are even, and notice that i and j are either both even 
or both odd, since x, = y, and the odd-subscripted vertices of our path belong to B 
while those with even subscripts belong to A. Thus, i + j is even, so n + in -(/ + /) + 1 
is odd, giving a contradiction. □ 


A graph G is called a bipartite graph when there is a partition of the vertex V into 
two sets A and B so that the subgraphs induced by A and B are independent graphs, 
i.e., no edge of G has both of its endpoints in A or in B. Evidently, bipartite graphs 
are 2-colorable. On the other hand, when a 2-colorable graph is disconnected, there is 
more than one way to define a suitable partition of the vertex set into two independent 
sets. 

Bipartite graphs are commonly used as models when there are two distinct types 
of objects being modeled and connections are only allowed between two objects of 
different types. For example, on one side, list candidates who attend a career fair and 
on the other side list the available positions. The edges might naturally correspond to 
candidate/ position pairs which link a person to a responsibility they are capable of 
handling. 

As a second example, a bipartite graph could be used to visualize the languages 
spoken by a group of students. The vertices on one side would be the students with 
the languages listed on the other side. We would then have an edge xy when student 
x spoke language y. A concrete example of this graph for our favorite group of stu- 
dents is shown in Figure 5.22, although Alice isn't so certain there should be an edge 
connecting Dave and English. 

One special class of bipartite graphs that bears mention is the class of complete bi- 
partite graphs. The complete bipartite graph K m/ „ has vertex set V = V\ U V 2 with 
| Vi | = m and | V 2 1 = n. It has an edge x y if and only if x e V\ and ye V 2 • The complete 
bipartite graph K 3 3 is shown in Figure 5.23. 
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Alice Bob Carlos Dave Xing Yolanda Zori 
Figure 5.22: A bipartite graph 



Figure 5.23: The complete bipartite graph K3 3 

5.4.2 Cliques and Chromatic Number 

A clique in a graph G = ( V , E ) is a set K c V such that the subgraph induced by K 
is isomorphic to the complete graph Km. Equivalently, we can say that every pair of 
vertices in K are adjacent. The maximum clique size or clique number of a graph 
G, denoted a>(G) , is the largest t for which there exists a clique K with j/<| = f. For 
example, the graph in Figure 5.14 has clique number 4 while the graph in Figure 5.19 
has maximum clique size 2. 

For every graph G, it is obvious that ,y(G) > &>(G). On the other hand, the inequality 
may be far from tight. Before proving showing how bad it can be, we need to introduce 
a more general version of the Pigeon Hole Principle. Consider a function / : X — » Y 
with |X| = 2|Y| + 1. Since |X| > \Y\, the Pigeon Hole Principle as stated in Propo- 
sition 4.1 only tells us that there are distinct x,x' e X with f(x) = fix'). However, 
we can say more here. Suppose that each element of Y has at most two elements of 
X mapped to it. Then adding up the number of elements of X based on how many 
are mapped to each element of Y would only allow X to have (at most) 2| Y| elements. 
Thus, there must be y e Y so that there are three distinct elements x, x' , x" e X with 
f{x) = fix') = fix") = y. This argument generalizes to give the following version of 
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the Pigeon Hole Principle: 

Proposition 5.24 (Generalized Pigeon Hole Principle). If f : X — > Y is a function and 
|X| > (m - 1)| Y | + 1, then there exists an element y e Y and distinct elements x \, . . . , x m e X 
so that f(xj) = y for i = 1 , . . . , m. 

We are now prepared to present the following proposition showing that clique num- 
ber and chromatic number need not be close at all. We give two proofs. The first is the 
work of J. Kelly and L. Kelly, while the second is due to J. Mycielski. 

Proposition 5.25. For every t >3, there exists a graph Gf so that y(Gf) = t and co(Gt) = 2. 

Proof. We proceed by induction on t. For t = 3, we take G 3 to be the cycle C 5 on five 
vertices. Now assume that for some t > 3, we have determined the graph Gf . Suppose 
that Gf has «f vertices. Label the vertices of Gf as x\,xi, . . . ,x nt . Construct Gf+i as 
follows. Begin with an independent set I of cardinality t(«f — 1) + 1. For every subset 
S of I with |S| = n t , label the elements of S as yi, 3/2, . . . , y n , ■ For this particular n t - 
element subset attach a copy of Gf with y, adjacent to x; for i = 1,2, . . . , nt . Vertices in 
copies of Gf for distinct n t -element subsets of I are nonadjacent, and a vertex in I has 
at most one neighbor in a particular copy of Gf . 

To see that a>(Gf+i) = 2, it will suffice to argue that Gf+i contains no triangle (K 3 ). 
Since Gf is triangle-free, any triangle in Gf+i must contain a vertex of I. Since none of 
the vertices of I are adjacent, any triangle in Gf+i contains only one point of I. Since 
each vertex of I is adjacent to at most one vertex of any fixed copy of Gf, if y e I is part 
of a triangle, the other two vertices must come from distinct copies of Gf. However, 
vertices in different copies of Gf are not adjacent, so o>(Gf+i) = 2. Notice that ,y(Gf + i) > 
t since Gf+i contains Gf. On the other hand, y(G/ + i j < t + 1 since we may use t colors 
on the copies of Gf and a new color on the independent sett. To see that j(Gf+i ) = t + 1, 
observe that if we use only t colors, then by the generalized Pigeon Hole Principle, 
there is an n t -element subset of I in which all vertices have the same color. Then this 
color cannot be used in the copy of Gf which is attached to that nt -element subset. □ 

Proof. We again start with G 3 as the cycle C 5 . As before we assume that we have con- 
structed for some t > 3 a graph Gf with a>(Gi) = 2 and y(G/ ) = t. Again, label the 
vertices of Gf as x\, X 2 , ■ ■ ■ , x nt . To construct Gf+i, we now start with an independent 
set I, but now I has only n t points, which we label as yi, yi, ■ ■ ■ , y» r We then add a 
copy of Gf with y, adjacent to x , if and only if x, is adjacent to x ( . Finally, attach a new 
vertex z adjacent to all vertices in I. 

Clearly, a>(Gf + i) = 2. Also, y(Gf + i) > f, since it contains Gf as a subgraph. Further- 
more, x(Gf + i) < t + 1, since we can color Gf with colors from {1,2,..., t }, use color 
t + 1 on the independent set I , and then assign color 1 to the new vertex z . We claim that 
in fact x(G f+ i) = f+1. Suppose not. Then we must have y(G (+ i) = t. Let (j) be a proper 
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coloring of Gf+i. Without loss of generality, cp uses the colors in {1,2, . . . , t} and cp as- 
signs color t to z. Then consider the nonempty set S of vertices in the copy of Gf to 
which (p assigns color f. For each x, in S, change the color on x, so that it matches the 
color assigned to y; by <p, which cannot be f, as z is colored t. What results is a proper 
coloring of the copy of G; with only t — 1 colors since x, and y, are adjacent to the same 
vertices of the copy of Gf . The contradiction shows that y(Gf + i) = t + 1, as claimed. □ 

Since a 3-clique looks like a triangle. Proposition 5.25 is often stated as "There exist 
triangle-free graphs with large chromatic number." As an illustration of the construc- 
tion in the proof of Mycielski, we again refer to Figure 5.19. The graph shown is G 4 . We 
will return to the topic of graphs with large chromatic number in Section 11.6 where we 
show that are there graphs with large chromatic number which lack not only cliques 
of more than two vertices but also cycles of fewer than g vertices for any value of g. In 
other words, there is a graph G with y(G) = 10 6 but no cycle with fewer than 10 10 
vertices! 

5.4.3 Can We Determine Chromatic Number? 

Suppose you are given a graph G. It's starting to look like it is not easy to find an 
algorithm that answers the question "Is y(G) < t?" It's easy to verify a certificate (a 
proper coloring using at most t colors), but how could you even find a proper color- 
ing, not to mention one with the fewest number of colors? Similarly for the question 
"Is a>(G) > /c?", it is easy to verify a certificate. Flowever, finding a maximum clique 
appears to be a very hard problem. Of course, since the gap between ^(G) and co(G) 
can be arbitrarily large, being able to find one value would not (generally) help in find- 
ing the value of the other. No polynomial-time algorithm is known for either of these 
problems, and many believe that no such algorithm exists. In this subsection, we look 
at one approach to finding chromatic number and see a case where it does work effi- 
ciently. 

A very naive algorithmic way to approach graph coloring is the First Fit, or "greedy", 
algorithm. For this algorithm, fix an ordering of the vertex set V = {v\, i> 2 , . . . v n }. We 
define the coloring function <p one vertex at a time in increasing order of subscript. We 
begin with (p(v{) = 1 and then we define (p(v l+ \ ) (assuming vertices V\, Vi, ■ ■ ■ , i’i have 
been colored) to be the least positive integer color that has not already been used on 
any of its neighbors in the set {v\, . . . v, }. 

Figure 5.26 shows two different orderings of the same graph. Exercise 5.9.24 demon- 
strates that the ordering of V is vital to the ability of the First Fit algorithm to color G 
using A'(G) colors. In general, finding an optimal ordering is just as difficult as coloring 
G. Thus, this very simple algorithm does not work well in general. Flowever, for some 
classes of graphs, there is a "natural" ordering that leads to optimal performance of 
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Figure 5.26: Two orderings of the vertices of a bipartite graph. 


First Fit. Here is one such example — one that we will study again in the next chapter 
in a different context. 

Given an indexed family of sets F = {S a : a e V}, we associate with F a graph 
G defined as follows. The vertex set of G is the set V and vertices x and y in V are 
adjacent in G if and only if S x n Sy + 0. We call G an intersection graph. It is easy to 
see that every graph is an intersection graph (Why?), so it makes sense to restrict the 
sets which belong to F ■ For example, we call G an interval graph if it is the intersection 
graph of a family of closed intervals of the real line R. For example, in Figure 5.27, we 
show a collection of six intervals of the real line on the left. On the right, we show the 
corresponding interval graph having an edge between vertices x and y if and only if 
intervals x and y overlap. 



Figure 5.27: A collection of intervals and its interval graph 


Theorem 5.28. If G = (V, E ) is an interval graph, then y(G) = <n(G). 

Proof. For each v e V, let l(v) = [a v , b v ] be a closed interval of the real line so that nv 
is an edge in G if and only if I(u) D l(v) + 0. Order the vertex set V as {v\, Vi, ■ ■ ■ v n } 
such that a i < a 2 < ■■■ < a n . (Ties may be broken arbitrarily.) Apply the First Fit 
coloring algorithm to G with this ordering on V . Now when the First Fit coloring 
algorithm colors v u all of its neighbors have left end point at most a,. Since they are 
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neighbors of i however, we know that their right endpoints are all at least a,. Thus, 
Vj and its previously-colored neighbors form a clique. Hence, z>, is adjacent to at most 
oi(G) - 1 other vertices that have already been colored, so when the algorithm colors 
Vj, there will be a color from {1,2, ... , <u(G)} not already in use on its neighbors. The 
algorithm will assign zy the smallest such color. Thus, we never need to use more than 
o;(G) colors, so t(G) = o;(G). □ 

A graph G is said to be perfect if A'(H) = a>(H) for every induced subgraph H. Since 
an induced subgraph of an interval graph is an interval graph. Theorem 5.28 shows 
interval graphs are perfect. The study of perfect graphs originated in connection with 
the theory of communications networks and has proved to be a major area of research 
in graph theory for many years now. 


5.5 Planar Graphs 


Let's return to the problem of providing lines for water, electricity, and natural gas 
to three homes which we discussed in the introduction to this chapter. How can we 
model this problem using a graph? The best way is to have a vertex for each utility 
and a vertex for each of the three homes. Then what we're asking is if we can draw the 
graph that has an edge from each utility to each home so that none of the edges cross. 
This graph is shown in Figure 5.29. You should recognize it as the complete bipartite 
graph K 3 3 we introduced earlier in the chapter. 


Water ct- — 

—p Home 1 

Hnmp ? 

Natural gas 0 — — 

— hd Home 3 


Figure 5.29: A graph of connecting homes to utilities 

While this example of utility lines might seem a bit contrived, since there's really no 
good reason that the providers can't bury their lines at different depths, the question 
of whether a graph can be drawn in the plane such that edges intersect only at vertices 
is a long-studied question in mathematics that does have useful applications. One area 
where it arises is in the design of microchips and circuit boards. In those contexts, the 
material is so thin that the option of placing connections at different depths either does 
not exist or is severely restricted. There is much deep mathematics that underlies this 
area, and this section is intended to introduce a few of the key concepts. 
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By a drawing of a graph, we mean a way of associating its vertices with points in 
the Cartesian plane R 2 and its edges with simple polygonal arcs whose endpoints are 
the points associated to the vertices that are the endpoints of the edge. You can think 
of a polygonal arc as just a finite sequence of line segments such that the endpoint of 
one line segment is the starting point of the next line segment, and a simple polygonal 
arc is one that does not cross itself. (Our choice of polygonal arcs rather than arbitrary 
curves actually doesn't cause an impediment, since by taking very, very, very short line 
segments we can approximate any curve.) A planar drawing of a graph is one in which 
the polygonal arcs corresponding to two edges intersect only at a point corresponding 
to a vertex to which they are both incident. A graph is planar if it has a planar drawing. 
A face of a planar drawing of a graph is a region bounded by edges and vertices and 
not containing any other vertices or edges. 

Figure 5.30 shows a planar drawing of a graph with 6 vertices and 9 edges. Notice 
how one of the edges is drawn as a true polygonal arc rather than a straight line seg- 
ment. This drawing determines 5 regions, since we also count the unbounded region 
that surrounds the drawing. 



Figure 5.30: A planar drawing of a graph 


Figure 5.31 shows a planar drawing of the complete graph K 4 . There are 4 vertices, 
6 edges, and 4 faces in the drawing. 
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What happens if we compute the number of vertices minus the number of edges 
plus the number of faces for these drawings? We have 


6-9 + 5 = 2 
4 - 6 + 4 = 2 

While it might seem like a coincidence that this computation results in 2 for these 
planar drawings, there's a more general principle at work here, and in fact it holds for 
any planar drawing of any planar graph. 

In fact, the number 2 here actually results from a fundamental property of the plane, 
and there are a corresponding theorems for other surfaces. However, we only need the 
result as stated above. 

Theorem 5.32 (Euler's Formula). Let G be a connected planar graph with n vertices and m 
edges. Every planar draining of G has f faces , where f satisfies 


n - m + f = 2. 


Proof. Our proof is by induction on the number m of edges. If m = 0, then since G is 
connected, our graph has a single vertex, and so there is one face. Thus n - m + f = 
1-0 + 1 = 2 as needed. Now suppose that we have proven Euler's formula for all 
graphs with less than m edges and let G have m edges. Pick an edge e of G. What 
happens if we form a new graph G' by deleting e from G? If G' is connected, our 
inductive hypothesis applies. Say that G' has n' vertices, m' edges, and /' faces. Then 
by induction, these numbers satisfy 

n'-m' + f = 2. 
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Since we only deleted one edge, n' = n and m' = m - 1. What did the removal of e do 
to the number of faces? In G' there's a new face that was formerly two faces divided 
by e in G. Thus, f = / - 1. Substituting these into n' — m'+f = 2, we have 

n — (m — 1) + (/ — 1) = 2 <==> n - m + f = 2. 

Thus, if G' is connected, we are done. If G' is disconnected, however, we cannot apply 
the inductive assumption to G' directly. Fortunately, since we removed only one edge, 
G' has two components, which we can view as two connected graphs G'| and G' 2 . Each 
of these has fewer than m edges, so we may apply the inductive hypothesis to them. 
For i = 1, 2, let n ' be the number of vertices of G', ml the number of edges of G', and 
f. the number of faces of G'. Then by induction we have 

n[ - m[ + f[ = 2 and n' 2 - m' 2 + f 2 = 2. 

Adding these together, we have 

0! + n' 2 ) ~ ( + m' 2 ) + {f[ + f 2 ) = 4. 

But now n = n' 2 + n' 2 , and m ' x + m' 2 = m - 1, so the equality becomes 

n - (m - 1) + (f[ + f 2 ) = 4 <==> n - m + (/{ + f 2 ) = 3. 

The only thing we have yet to figure out is how /' + f 2 relates to /, and we have to 
hope that it will allow us to knock the 3 down to a 2. Every face of G' and G' 2 is a 
face of G, since the fact that removing e disconnects G means that e must be part of 
the boundary of the unbounded face. Further, the unbounded face is counted twice in 
the sum /[ + f 2 , so / = /' + f 2 - 1. This gives exactly what we need to complete the 
proof. □ 

Taken by itself, Euler's formula doesn't seem that useful, since it requires counting 
the number of faces in a planar embedding. However, we can use this formula to get a 
quick way to determine that a graph is not planar. Consider a drawing without edge 
crossings of a graph on n vertices and m edges, with n > 3. We consider pairs (e, F) 
where e is an edge of G and F is a face that has e as part of its boundary. How many 
such pairs are there? Let's call the number of pairs p. Each edge can bound either one 
or two faces, so we have that p < 2m. We can also bound p by counting the number of 
pairs in which a face F appears. Each face is bounded by at least 3 edges, so it appears 
in at least 3 pairs, and so p > 3 /. Thus 3/ < 2 in or f < 2m /3. Now, utilizing Euler's 
formula, we have 

^ „ 2wz „ m 

m = n + f -2 < n + — — 2 <=» — < n — 2. 

J 3 3 

Thus, we've proven the following theorem. 
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Theorem 5 . 33 . A planar graph on n vertices has at most 3n - 6 edges when n > 3. 

The contrapositive of this theorem, namely that an n -vertex graph with more than 
3 n - 6 edges is not planar, is usually the most useful formulation of this result. For 
instance, we've seen (Figure 5.31) that IQ is planar. What about K 5 ? It has 5 vertices 
and C( 5, 2) = 10>9 = 3- 5- 6 edges, so it is not planar, and thus for n > 5, K„ is not 
planar, since it contains K5. It's important to note that Theorem 5.33 is not the be-all, 
end-all of determining if a graph is planar. To see this, let's return to the subject of 
drawing K 33 in the plane. This graph has 6 vertices and 9 edges, so it passes the test 
of Theorem 5.33. However, if you spend a couple minutes trying to find a way to draw 
K 3 3 in the plane without any crossing edges, you'll pretty quickly begin to believe that 
it can't be done — and you'd be right! 

To see why K3 3 is not planar, we'll have to return to Euler's formula, and we again 
work with edge-face pairs. For K33, we see that every edge would have to be part of 
the boundary of two faces, and faces are bounded by cycles. Also, since the graph 
is bipartite, there are no odd cycles. Thus, counting edge-face pairs from the edge 
perspective, we see that there are 2m = 18 pairs. If we let f/ c be the number of faces 
bounded by a cycle of length k, then f = fi+ fe- Thus, counting edge-face pairs from 
the face perspective, there are 4/4 + 6 fe pairs. From Euler's formula, we see that the 
number of faces / must be 5, so then 4/4 + 6fe > 20. But from our count of edge-face 
pairs, we have 2m = 4/4 + 6/g, giving 18 > 20, which is clearly absurd. Thus, K33 is 
not planar. 

At this point, you're probably asking yourself "So what?" We've invested a fair 
amount of effort to establish that K5 and K3 3 are nonplanar. Clearly any graph that 
contains them is also nonplanar, but there are a lot of graphs, so you might think that 
we could be at this forever. Fortunately, we won't be, since at its core, planarity really 
comes down to just these two graphs, as we shall soon see. 

If G = (V,E) is a graph and uv £ E, then we may form a new graph G' called 
an elementary subdivision of G by adding a new vertex v' and replacing the edge 
uv by edges uv' and v'v. In other words, G' has vertex set V' = V U {v'j and edge 
set £' = (£- {uv}) U {uv', v'v}. Two graphs Gi and G2 are homeomorphic if they 
can be obtained from the same graph by a (potentially trivial) sequence of elementary 
subdivisions. 

The purpose of discussing homeomorphic graphs is that two homeomorphic graphs 
have the same properties when it comes to being drawn in the plane. To see this, think 
about what happens to K 5 if we form an elementary subdivision of it via any one of its 
edges. Clearly it remains nonplanar. In fact, if you take any nonplanar graph and form 
the elementary subdivision using any one of its edges, the resulting graph is nonplanar. 
The following very deep theorem was proved by the Polish mathematician Kazimierz 
Kuratowski in 1930. Its proof is beyond the scope of this text. 
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Theorem 5.34 (Kuratowski's Theorem). A graph is planar if and only if it does not contain 
a subgraph komeomorphic to either K5 or K33. 

Kuratowski's Theorem gives a useful way for checking if a graph is planar. Although 
it's not always easy to find a subgraph homeomorphic to K5 or K3 3 by hand, there are 
efficient algorithms for planarity testing that make use of this characterization. To see 
this theorem at work, let's consider the Petersen graph shown in Figure 5.17. The Pe- 
tersen graph has 10 vertices and 15 edges, so it passes the test of Theorem 5.33, and our 
argument using Euler's formula to prove that K33 is nonplanar was complex enough, 
we probably don't want to try it for the Petersen graph. To use Kuratowski's Theorem 
here, we need to decide if we would rather find a subgraph homeomorphic to K5 or 
to K3 3. Although the Petersen graph looks very similar to K5, it's actually simultane- 
ously too similar and too different for us to be able to find a subgraph homeomorphic 
to K5, since each vertex has degree 3. Thus, we set out to find a subgraph of the Pe- 
tersen graph homeomorphic to K3 3. To do so, note that K33 contains a cycle of length 
6 and three edges that are in place between vertices opposite each other on the cy- 
cle. We identify a six-cycle in the Petersen graph and draw it as a hexagon and place 
the remaining four vertices inside the cycle. Such a drawing is shown in Figure 5.35. 
The subgraph homeomorphic to K33 is found by deleting the black vertex, as then the 
white vertices have degree two, and we can replace each of them and their two incident 
edges (shown in bold) by a single edge. 



Figure 5 . 35 : A more illustrative drawing of the Petersen graph 

We close this section with a problem that brings the current section together with 
the topic of graph coloring. In 1852 Francis Guthrie, an Englishman who was at the 
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time studying to be lawyer but subsequently became a professor of mathematics in 
South Africa, was trying to color a map of the counties of England so that any two 
counties that shared a boundary segment (meaning they touched in more than a single 
point) were colored with different colors. He noticed that he only needed four colors 
to do this, and was unable to draw any sort of map that would require five colors. (He 
was able to find a map that required four colors, an example of which is shown in 
Figure 5.36.) 



Figure 5.36: A map that requires four colors 

Could it possibly be true that every map could be colored with only four colors? 
He asked his brother Frederick Guthrie, who was a mathematics student at Univer- 
sity College, London, about the problem, and Frederick eventually communicated the 
problem to Augustus de Morgan (of de Morgan's laws fame), one of his teachers. It 
was in this way that one of the most famous (or infamous) problems, known for a cen- 
tury as the Four Color Problem and now the Four Color Theorem, in graph theory was 
born. De Morgan was very interested in the Four Color Problem, and communicated 
it to Sir William Rowan Hamilton, a prominent Irish mathematician and the one for 
whom hamiltonian cycles are named, but Hamilton did not find the problem interest- 
ing. Hamilton is one of the few people who considered the Four Color Problem but 
did not become captivated by it. 

We'll continue our discussion of the history of the Four Color Theorem in a moment, 
but first, we must consider how we can turn the problem of coloring a map into a 
graph theory question. Well, it seems natural that each region should be assigned a 
corresponding vertex. We want to force regions that share a boundary to have different 
colors, so this suggests that we should place an edge between two vertices if and only 
if their corresponding regions have a common boundary. (As an example, the map in 
Figure 5.36 corresponds to the graph K 4 .) It is not difficult to see that this produces a 
planar graph, since we may draw the edges through the common boundary segment. 
Furthermore, with a little bit of thought, you should see that given a planar drawing of 
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a graph, you can create a map in which each vertex leads to a region and edges lead to 
common boundary segments. Thus, the Four Color Problem could be stated as "Does 
every planar graph have chromatic number at most four?" 

Interest in the Four Color Problem languished until 1877, when the British mathe- 
matician Arthur Cayley wrote a letter to the Royal Society asking if the problem had 
been resolved. This brought the problem to the attention of many more people, and 
the first "proof" of the Four Color Theorem, due to Alfred Bray Kempe, was completed 
in 1878 and published a year later. It took 11 years before Percy John Fleawood found 
a flaw in the proof but was able to salvage enough of it to show that every planar 
graph has chromatic number at most five. In 1880, Peter Guthrie Tait, a British physi- 
cist best known for his book Treatise on Natural Philosophy with Sir William Thomson 
(Lord Kelvin), made an announcement that suggested he had a proof of the Four Color 
Theorem utilizing hamiltonian cycles in certain planar graphs. Flowever, consistent 
with the way Tait approached some conjectures in the mathematical theory of knots, 
it appears that he subsequently realized around 1883 that he could not prove that the 
hamiltonian cycles he was using actually existed and so Tait likely only believed he 
had a proof of the Four Color Theorem for a short time, if at all. Flowever, it would 
take until 1946 to find a counterexample to the conjecture Tait had used in his attempt 
to prove the Four Color Theorem. 

In the first half of the twentieth century, some incremental progress toward resolving 
the Four Color Problem was made, but few prominent mathematicians took a serious 
interest in it. The final push to prove the Four Color Theorem came with about at 
the same time that the first electronic computers were coming into widespread use 
in industry and research. In 1976, two mathematicians at the University of Illinois 
announced their computer-assisted proof of the Four Color Theorem. The proof by 
Kenneth Appel and Wolfgang Haken led the University of Illinois to add the phrase 
"FOUR COLORS SUFFICE" to its postage meter's imprint. 1 

Theorem 5.37 (Four Color Theorem). Every planar graph has chromatic number at most 
four. 

Appel and Flaken's proof of the Four Color Theorem was at a minimum unsatisfac- 
tory for many mathematicians, and to some it simply wasn't a proof. These mathemati- 
cians felt that the using a computer to check various cases was simply too uncertain; 
how could you be certain that the code that checked the 1,482 "unavoidable configu- 
rations" didn't contain any logic errors? In fact, there were several mistakes found in 
the cases analyzed, but none were found to be fatal flaws. In 1989, Appel and Flaken 
published a 741-page tome entitled Every Planar Map is Four Colorable which provided 
corrections to all known flaws in their original argument. This still didn't satisfy many, 

1 A photograph of an envelope with such a meter mark on it can be found in the book The Four-Color Theorem : 

History, Topological Foundations, and Idea of Proof by Rudolf and Gerda Fritsch. (Springer, 1998) 


95 


Chapter 5 Graph Theory 


and in the early 1990's a team consisting of Neil Robertson from The Ohio State Uni- 
versity; Daniel R Sanders, a graduate student at the Georgia Institute of Technology; 
Paul Seymour of Bellcore; and Robin Thomas from Georgia Tech announced a new 
proof of the Four Color Theorem. However, it still required the use of computers. The 
proof did gain more widespread acceptance than that of Appel and Haken, in part 
because the new proof used fewer than half (633) of the number of configurations the 
Appel-Haken proof used and the computer code was provided online for anyone to 
verify. While still unsatisfactory to many, the proof by Robertson, et al. was generally 
accepted, and today the issue of the Four Color Theorem has largely been put to rest. 
However, many still wonder if anyone will ever find a proof of this simple statement 
that does not require the assistance of a computer. 


5.6 Counting Labeled Trees 

How many trees are there with vertex set [n] = {1,2 ,...,«}? Let T n be this number. 
For n = 1, there is clearly only one tree. Also, for n = 2, there is only one tree, which 
is isomorphic to K 2 . In determining T3, we finally have some work to do; however, 
there's not much, since all trees on 3 vertices are isomorphic to P3. Thus, there are 
T 3 = 3 labeled trees on 3 vertices, corresponding to which vertex is the one of degree 
2. When n = 4, we can begin by counting the number of nonisomorphic trees and 
consider two cases depending on whether the tree has a vertex of degree 3. If there is 
a vertex of degree 3, the tree is isomorphic to K 13 or it does not have a vertex of degree 
three, in which case it is isomorphic to P4, since there must be precisely two vertices 
of degree 2 in such a graph. There are four labelings by [4] for Kj 3 (choose the vertex 
of degree three). How many labelings by [4] are there for P4? There are C(4, 2) ways 
to choose the labels i, j given to the vertices of degree 2 and two ways to select one of 
the remaining labels to be made adjacent to i. Thus, there are 12 ways to label P4 by 
[4] and so T 4 = 16. 

To this point, it looks like maybe there's a pattern forming. Perhaps it is the case 
that for all n > 1, T n = n"“ 2 . This is in fact the case, but let's see how it works out 
for n = 5 before proving the result in general. What are the nonisomorphic trees on 
five vertices? Well, there's Ki 4 and P5 for sure, and there's also the third tree shown in 
Figure 5.38. After thinking for a minute or two, you should be able to convince yourself 
that this is all of the possibilities. How many labelings by [5] does each of these have? 
There are 5 for K14 since there are 5 ways to choose the vertex of degree 4. For P5, there 
are 5 ways to choose the middle vertex of the path, C(4, 2) = 6 ways to label the two 
remaining vertices of degree 2 once the middle vertex is labeled, and then 2 ways to 
label the vertices of degree 1. This gives 60 labelings. For the last tree, there are 5 ways 
to label the vertex of degree 3, C(4, 2) = 6 ways to label the two leaves adjacent to the 


96 


5.6 Counting Labeled Trees 


vertex of degree 3, and 2 ways to label the remaining two vertices, giving 60 labelings. 
Therefore, T5 = 125 = 5 3 = 5 5 ~ 2 . 



A 



Figure 5.38: The nonisomorphic trees on n = 5 vertices 


It turns out that we are in fact on the right track, and we will now set out to prove 
the following: 

Theorem 5.39 (Cayley's Formula). The number T n of labeled trees on n vertices is n n ~ 2 . 

This result is usually referred to as Cayley's Formula, although equivalent results 
were proven earlier by James J. Sylvester (1857) and Carl W. Borchardt (1860). The rea- 
son that Cayley's name is most often affixed to this result is that he was the first to state 
and prove it in graph theoretic terminology (in 1889). (Although one could argue that 
Cayley really only proved it for n = 6 and then claimed that it could easily be extended 
for all other values of n , and whether such an extension can actually happen is open to 
some debate.) Cayley's Formula has many different proofs, most of which are quite el- 
egant. If you're interested in presentations of several proofs, we encourage you to read 
the chapter on Cayley's Formula in Proofs from THE BOOK by Aigner, Ziegler, and Flof- 
mann, which contains four different proofs, all using different proof techniques. Flere 
we give a fifth proof, due to Priifer and published in 1918. Interestingly, even though 
Prater's proof came after much of the terminology of graph theory was established, he 
seemed unaware of it and worked in the context of permutations and his own termi- 
nology, even though his approach clearly includes the ideas of graph theory. We will 
use a recursive technique in order to find a bijection between the set of labeled trees 
on n vertices and a natural set of size n"~ 2 , the set of strings of length n —2 where the 
symbols in the string come from [n]. 

We define a recursive algorithm that takes a tree Tont > 2 vertices labeled by 
elements of a set S of positive integers of size k and returns a string of length k — 2 
whose symbols are elements of S. (The set S will usually be [k], but in order to define a 
recursive procedure, we need to allow that it be an arbitrary set of k positive integers.) 
This string is called the Priifer code of the tree T. Let priifer(T) denote the Priifer code 
of the tree T, and if v is a leaf of T, let T—v denote the tree obtained from T by removing 
v (i.e., the subgraph induced by all the other vertices). We can then define prufer(T) 
recursively by the following procedure. 
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1. If T = K 2 , return the empty string. 

2. Else, let v be the leaf of T with the smallest label and let u be its unique neighbor. 
Let i be the label of u. Return (i, priifer(T - z>)). 

Example 5.40. Before using Priifer codes to prove Cayley's Formula, let's take a mo- 
ment to make sure we understand how they are computed given a tree. Consider the 
9-vertex tree T in Figure 5.41. 



Figure 5.41: A labeled 9-vertex tree 


How do we compute priifer(T)? Since T has more than two vertices, we use the 
second step and find that v is the vertex with label 2 and u is the vertex with label 6, 
so priifer(T) = (6,prirfer(T - v)). The graph T - v is shown in Figure 5.42. 



Figure 5.42: The tree T - v 


The recursive call prirferfT - v) returns (6, prufer(T - v - v')), where v' is the vertex 
labeled 5. Continuing recursively, the next vertex deleted is 6, which appends a 4 to 
the string. Then 7 is deleted, appending 3. Next 8 is deleted, appending 1. This is 
followed by the deletion of 1, appending 4. Finally 4 is deleted, appending 3, and the 
final recursive call has the subtree isomorphic to K 2 with vertices labeled 3 and 9, and 
an empty string is returned. Thus, prirfer(T) = 6643143. 

We're now prepared to give a proof of Cayley's Formula. 

Proof. It is clear that priifer(T) takes an n -vertex labeled tree with labels from [n] and 
returns a string of length n — 2 whose symbols are elements of [n]. What we have yet 
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to do is determine a way to take such a string and construct an n-vertex labeled tree 
from it. If we can find such a construction, we will have a bijection between the set T n 
of labeled trees on n vertices and the set of strings of length n — 2 whose symbols come 
from [n], which will imply that T„ = n n ~ 2 . 

First, let's look at how priifer(T) behaves. What numbers actually appear in the 
Pr lifer code? The numbers that appear in the Priifer code are the labels of the non- 
leaf vertices of T. The label of a leaf simply cannot appear, since we always record the 
label of the neighbor of the leaf we are deleting, and the only way we would delete the 
neighbor of a leaf is if that neighbor were also a leaf, which can only happen T = K2, in 
which case priifer(T) simply returns the empty string. Thus if I c [n] is the set of sym- 
bols that appear in priifer(T), the labels of the leaves of T are precisely the elements of 
[n]-I. 

With the knowledge of which labels belong to the leaves of T in hand, we are ready 
to use induction to complete the proof. Our goal is to show that if given a string s = 
S1S2 • ■ • s n ~2 whose symbols come from a set S of n elements, there is a unique tree T 
with priifer(T) = s. If n = 2, the only such string is the empty string, so 1 and 2 both 
label leaves and we can construct only K2. Now suppose we have the result for some 
m > 2, and we try to prove it for m + 1. We have a string s = SiS2 ---s m _i with symbols 
from [ m + 1]. Let I be the set of symbols appearing in s and let k be the least element 
of [m + 1] — I. By the previous paragraph, we know that k is the label of a leaf of T 
and that its unique neighbor is the vertex labeled Si. The string s' = S2S3 • • • s m _i has 
length m — 2 and since k does not appear in s, its symbols come from S = [m + 1] - {k}, 
which has size m. Thus, by induction, there is a unique tree T' whose Priifer code is 
s'. We form T from T' by attaching a leaf with label k to the vertex of T' with label Si 
and have a tree of the desired type. □ 


Example 5.43. We close this section with an example of how to take a Priifer code and 
use it to construct a labeled tree. Consider the string s = 75531 as a Priifer code. Then 
the tree T corresponding to s has 7 vertices, and its leaves are labeled 2, 4, and 6. The 
inductive step in our proof attaches the vertex labeled 2 to the vertex labeled 7 in the 
tree T' with Priifer code 5531 and vertex labels {1, 3,4, 5, 6, 7}, since 2 is used to label 
the last vertex added. What are the leaves of T'? The symbols in {4, 6, 7} do not appear 
in 5531, so they must be the labels of leaves, and the construction says that we would 
attach the vertex labeled 4 to the vertex labeled 5 in the tree we get by induction. In 
Table 5.44, we show how this recursive process continues. 
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Priifer code Label set Edge added 

75531 11,2,3,4,5,6,7} 2-7 

5531 {1,3,4,5,6,7} 4-5 

531 {1,3, 5, 6, 7} 6-5 

31 {1,3, 5, 7} 5-3 

1 {1,3,7} 3-1 

(empty string) {1,7} 1-7 


Table 5.44: Turning the Prufer code 75531 into a labeled tree 


We form each row from the row above it by removing the first label used on the edge 
added from the label set and removing the first symbol from the Prufer code. Once the 
Prufer code becomes the empty string, we know that the two remaining labels must 
be the labels we place on the ends of K 2 to start building T. We then work back up 
the edge added column, adding a new vertex and the edge indicated. The tree we 
construct in this manner is shown in Figure 5.45. 



5.7 A Digression into Complexity Theory 

We have already introduced in Chapter 4 a few notions about efficient algorithms. We 
also discussed the difficulty of determining a graph's chromatic number and clique 
number earlier in this chapter. We conclude with a brief discussion of some issues 
involving computational complexity for other problems discussed in this chapter. 

Let's begin with some problems for which there are polynomial-time algorithms. 
Suppose you are given a graph on n vertices and asked whether or not the graph is 
connected. Here a positive answer can be justified by providing a spanning tree. On 
the other hand, a negative answer can be justified by providing a partition of the vertex 
sets V = V 1 UV 2 with Vf and V 2 non-empty subsets and having no edges with one end- 
point in Vi and the other in VV In Chapter 12 we will discuss two efficient algorithms 
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that find spanning trees in connected graphs. They can easily be modified to produce 
a partition showing the graph is disconnected. 

If you are asked whether a connected graph is eulerian, then a positive answer can 
be justified by producing the appropriate sequence. We gave an algorithm to do this 
earlier in the chapter. A negative answer can be justified by producing a vertex of odd 
degree, and our algorithm will identify such a vertex if it exists. (Depending on the 
data structures used to represent the graph, it may be most efficient to simply look for 
vertices of odd degree without using the algorithm to find an eulerian circuit.) 

On the surface, the problem of determining if a graph is hamiltonian looks similar to 
that of determining if the graph is eulerian. Both call for a sequence of vertices in which 
each pair of consecutive vertices is joined by an edge. Of course, each problem has an 
additional requirement on yes certificates. However, justifying a negative answer to the 
question of whether a graph is hamiltonian is not straightforward. Theorem 5.18 only 
gives a way to confirm that a graph is hamiltonian; there are many nonhamiltonian 
graphs that do not satisfy its hypothesis. At this time, no one knows how to efficiently 
justify a negative answer — at least not in the general case. 


5.8 Discussion 

Over coffee, today's conversation was enthusiastic and heated at times. Zori got things 
off with a blast "I don't think graphs are of any use at all. . ." but she wasn't even able 
to finish the sentence before Yolanda uncharacteristically interrupted her with "You're 
off base on this one. I see lots of ways graphs can be used to model real world prob- 
lems. The professor actually showed us examples back in our first class. But now that 
we're talking in more depth about graphs, things are even clearer." Bob added, "These 
eulerian and hamiltonian cycle problems are certain to have applications in network 
routing problems." Xing reinforced Bob with "Absolutely. There are important ques- 
tions in network integrity and information exchange that are very much the same as 
these basic problems." Alice piled on "Even the notion of chromatic number clearly 
has practical applications." By this time, Zori realized her position was indefensible 
but she was reluctant to admit it. She offered only a "Whatever." 

Things quieted down a bit and Dave said "Finding a hamiltonian cycle can't be all 
that hard, if someone guarantees that there is one. This extra information must be of 
value in the search." Xing added "Maybe so. It seems natural that it should be easier 
to find something if you know it's there." Alice asked "Does the same thing hold for 
chromatic number?" Bob didn't understand her question "Huh?" Alice continued, 
this time being careful not to even look Bob's way "I mean if someone tells you that 
a graph is 3-colorable, does that help you to find a coloring using only three colors?" 
Dave said "Seems reasonable to me." 
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After a brief pause, Carlos offered "I don't think this extra knowledge is of any help. 
I think these problems are pretty hard, regardless." They went back and forth for a 
while, but in the end, the only thing that was completely clear is that graphs and their 
properties had captured their attention, at least for now. 

5.9 Exercises 

1 . The questions in this exercise pertain to the graph G shown in Figure 5.46. 


(a) What is the degree of vertex 8? 

(b) What is the degree of vertex 10? 

(c) How many vertices of degree 2 are there in G? 
List them. 

(d) Find a cycle of length 8 in G. 

(e) What is the length of a shortest path from 3 to 
4? 

(f) What is the length of a shortest path from 8 to 
7? 

(g) Find a path of length 5 from vertex 4 to vertex 

6 . 


2. Draw a graph with 8 vertices, all of odd degree, that does not contain a path of 
length 3 or explain why such a graph does not exist. 

3 . Draw a graph with 6 vertices having degrees 5, 4, 4, 2, 1, and 1 or explain why such 
a graph does not exist. 

4 . For the next Olympic Winter Games, the organizers wish to expand the number of 
teams competing in curling. They wish to have 14 teams enter, divided into two pools 
of seven teams each. Right now, they're thinking of requiring that in preliminary play 
each team will play seven games against distinct opponents. Five of the opponents will 
come from their own pool and two of the opponents will come from the other pool. 
They're having trouble setting up such a schedule, so they've come to you. By using 
an appropriate graph-theoretic model, either argue that they cannot use their current 
plan or devise a way for them to do so. 



Figure 5 . 46 : A graph 


102 


5.9 Exercises 

5 . For this exercise, consider the graph G in Figure 5.47. 

(a) Let V\ = {g,j,c,h,e,f} and Ei = {ge, jg,ch,ef}. Is (Vi,Ei) a subgraph of G? 

(b) Let V 2 = {g,j, c,h,e,f} and E 2 = {ge, jg,ch,ef,cj}. Is (V 2 , £ 2 ) a subgraph of 

G? 

(c) Let V 3 = {a, d, c, h, b} and £3 = {ch,ac,ad, be}. Is (V 3 , £ 3 ) an induced subgraph 
of G? 

(d) Draw the subgraph of G induced by {g , j, d, a, c, i } . 

(e) Draw the subgraph of G induced by { c, h , f, i, / }. 

(f) Draw a subgraph of G having vertex set {e, f,b,c,h, j} that is not an induced 
subgraph. 

(g) Draw a spanning subgraph of G with exactly 10 edges. 



6. Prove that every tree on n vertices has exactly n — 1 edges. 

7 . Figure 5.48 contains four graphs on six vertices. Determine which (if any) pairs of 
graphs are isomorphic. For pairs that are isomorphic, give an isomorphism between 
the two graphs. For pairs that are not isomorphic, explain why. 
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Ml U-2 



Figure 5 . 48 : Are these graphs isomorphic? 


8. Find an eulerian circuit in the graph G in Figure 5.49 or explain why one does not 
exist. 



9 . Consider the graph G in Figure 5.50. Determine if the graph is eulerian. If it is, 
find an eulerian circuit. If it is not, explain why it is not. Determine if the graph is 
hamiltonian. If it is, find a hamiltonian cycle. If it is not, explain why it is not. 
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e 



10. Explain why the graph G in Figure 5.51 does not have an eulerian circuit, but show 
that by adding a single edge, you can make it eulerian. 



11. An eulerian trail is defined in the same manner as an eulerian circuit (see Sec- 
tion 5.3) except that we drop the condition that Xq = x f . Prove that a graph has an 
eulerian trail if and only if it is connected and has at most two vertices of odd degree. 

12. Alice and Bob are discussing a graph that has 17 vertices and 129 edges. Bob argues 
that the graph is hamiltonian, while Alice says that he's wrong. Without knowing 
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anything more about the graph, must one of them be right? If so, who and why, and if 
not, why not? 

13. Find the chromatic number of the graph G in Figure 5.52 and a coloring using 
y(G) colors. 


h 



14. Find the chromatic number of the graph G in Figure 5.53 and a coloring using 
X(G) colors. 



Figure 5.53: A graph G to color 


15. A pharmaceutical manufacturer is building a new warehouse to store its supply of 
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10 chemicals it uses in production. However, some of the chemicals cannot be stored in 
the same room due to undesirable reactions that will occur. The matrix below has a 1 in 
position (z, y) if and only if chemical i and chemical j cannot be stored in the same room. 
Develop an appropriate graph theoretic model and determine the smallest number of 
rooms into which they can divide their warehouse so that they can safely store all 10 
chemicals in the warehouse. 

0 10110100 0 
1 0 0 1 1 0 0 0 0 1 

0 0 0 0 0 1 0 1 1 0 

1 1 0 0 1 0 0 0 0 0 

1 1 0 1 0 0 0 0 1 0 

0 0 1 0 0 0 1 0 0 1 

1 0 0 0 0 1 0 1 0 0 

0010001000 
0010100000 
0100010000 


16 . A school is preparing the schedule of classes for the next academic year. They are 
concerned about scheduling calculus, physics, English, statistics, economics, chem- 
istry, and German classes, planning to offer a single section of each one. Below are 
the lists of courses that each of six students must take in order to successfully gradu- 
ate. Determine the smallest number of class periods that can be used to schedule these 
courses if each student can take at most one course per class period. Explain why fewer 
class periods cannot be used. 

Student Courses 

1 Chemistry, Physics, Economics 

2 English, German, Statistics 

3 Statistics, Calculus, German 

4 Chemistry, Physics 

5 English, Chemistry 

6 Chemistry, Economics 


17 . All trees with more than one vertex have the same chromatic number. What is it, 
and why? 

18 . Find a proper (f + l)-coloring of the graph Gf+i in Mycielski's proof of Proposi- 
tion 5.25. This establishes that y(Gf+i) < t + 1. 
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19. How many vertices does the graph G 4 from the Kelly and Kelly proof of Proposi- 
tion 5.25 have? 

20. Construct and draw the graph G 5 from Mycielski's proof of Proposition 5.25. 

21. Find a recursive formula for the number of vertices Mf in the graph Gf from the 
Kelly and Kelly proof of Proposition 5.25. 

22. Let b t be the number of vertices in the graph Gf from the Mycielski's proof of 
Proposition 5.25. Find a recursive formula for bt . 

23. The girth of a graph G is the number of vertices in a shortest cycle of G. Find the 
girth of the graph Gf in the Kelly and Kelly proof of Proposition 5.25 and prove that 
your answer is correct. As a challenge, see if you can modify the construction of Gf to 
increase the girth. If so, how far are you able to increase it? 

24. Use the First Fit algorithm to color the graph in Figure 5.26 using the two different 
orderings of the vertex set shown there. 

25. Draw the interval graph corresponding to the intervals in Figure 5.54. 


I— — I I 

I 1 I — ■ — I 
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Figure 5.54: A collection of intervals 


26. Use the First Fit coloring algorithm to find the chromatic number of the interval 
graph whose interval representation is shown in Figure 5.54 as well as a proper color- 
ing using as few colors as possible. 

27. 

(a) From Exercise 5.9.24 you know that choosing a bad ordering of the vertices of 
a graph can lead to the First Fit coloring algorithm producing a coloring that is 
far from optimal. However, you can use this algorithm to prove a bound on the 
chromatic number. Show that if every vertex of G has degree at most D, then 
y(G) < D + 1. 

(b) Give an example of a bipartite graph with D = 1000 to show that this bound need 
not be tight. 
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28 . Is the graph in Figure 5.53 planar? If it is, find a drawing without edges crossings. 
If it is not give a reason why it is not. 

29 . Is the graph in Figure 5.55 planar? If it is, find a drawing without edge crossings. 
If it is not give a reason why it is not. 



30 . Find a planar drawing of the graph K 5 - e, by which we mean the graph formed 
from the complete graph on 5 vertices by deleting any edge. 

31 . Exhibit a planar drawing of an eulerian planar graph with 10 vertices and 21 edges. 

32 . Show that every planar graph has a vertex that is incident to at most five edges. 

33 . Let G = (V,E) be a graph with V = {v\,V 2 , ■ ■ ■ ,v n }. Its degree sequence is the 

list of the degrees of its vertices, arranged in nonincreasing order. That is, the degree 
sequence of G is (deg G (zq ), deg c ( z' 2 ), . . . , deg G (z'„)) with the vertices arranged such 
that deg G (zq) > deg c (z> 2 ) > ■ > deg c (z>„). Below are five sequences of integers 

(along with n, the number of integers in the sequence). Identify 

• the one sequence that cannot be the degree sequence of any graph ; 

• the two sequences that could be the degree sequence of a planar graph; 

• the one sequence that could be the degree sequence of a tree; 

• the one sequence that is the degree sequence of an eulerian graph; and 

• the one sequence that is the degree sequence of a graph that must be hamiltonian. 
Explain your answers. (Note that one sequence will get two labels from above.) 
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(a) n =10: (4, 4, 2, 2, 1,1, 1,1, 1,1) 

(b) n =9: (8, 8, 8, 6, 4, 4, 4, 4, 4) 

(c) n=7: (5,4,4,3,24,0) 

(d) n = 10: (7, 7, 6, 6, 6, 6, 5,5,5, 5) 

(e) n =6: (5, 4, 3, 2, 2, 2) 

34 . Below are three sequences of length 10. One of the sequences cannot be the degree 
sequence (see Exercise 5.9.33) of any graph. Identify it and say why. For each of the 
other two, say why (if you have enough information) a connected graph with that degree 
sequence 

• is definitely hamiltonian/ cannot be hamiltonian; 

• is definitely eulerian/ cannot be eulerian; 

• is definitely a tree/ cannot be a tree; and 

• is definitely planar / cannot be planar. 

(If you do not have enough information to make a determination for a sequence with- 
out having specific graph(s) with that degree sequence, write "not enough informa- 


tion" for that property.) 


(a) (6, 6, 4, 4, 4, 4, 2, 2, 2, 2) 

(b) (7,7,7,7,6,6,6,2,1,1) 

(c) (8,6,4,4,4,3,2,2,14) 


35 . For the two degree sequences in Exercise 5.9.34 that correspond to graphs, there 
were some properties for which the degree sequence was not sufficient information to 
determine if the graph had that property. For each of those situations, see if you can 
draw both a graph that has the property and a graph that does not have the property 

36 . Draw the 16 labeled trees on 4 vertices. 

37 . Determine priifer(T) for the tree T in Figure 5.56. 


3 


10 



Figure 5.56: A 10-vertex tree 
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38. Determine priifer(T) for the tree T in Figure 5.57. 



39. Determine priifer(T) for the tree T Figure 5.58. 



40. Construct the labeled tree T with Prater code 96113473. 

41. Construct the labeled tree T with Prater code 23134. 

42. Construct the labeled tree T with Prater code (using commas to separate symbols 
in the string, since we have labels greater than 9) 10, 1, 7, 4, 3, 4, 10, 2, 2, 8. 

43. (Challenge problem) When G = ( V , E) is a graph, let A(G) denote the maximum 
degree in G. Prove Brooks' Theorem: If G is connected and A(G) = k, then y(G) <k + 1. 


Ill 


Chapter 5 Graph Theory 


Furthermore, equality holds if and only if (a) k = 2 and G is an odd cycle, or (b) k + 1 
and G = Kjt+i. 

Hint. Hint: It's clear that ,y(G) < k + 1 (in fact, this was already assigned as an ex- 
ercise). Assume that ,y(G) = k + 1 but that neither conclusion (a) or (b) holds. Take 
a spanning tree of G and an appropriate ordering of the vertices, with two leaves of 
the tree coming first. Then show that a First Fit coloring of the graph will only use k 
colors. 
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CHAPTER 


Partially Ordered Sets 

Discussion 6.1. Alice was surfing the web and found a site listing top movies, grouped 
by categories (comedy, drama, family, etc) as well as by the decade in which they were 
released. Alice was intrigued by the critic's choices and his rankings, especially for the 
top seven dramas from the 1990's. Alice agreed with the critic's choices as a group but 
not the specific rankings. She wrote the critic's rankings on the board and just to the 
right, she gave her own rankings, all the time insisting that she was certainly correct in 
her opinions. 


Movie Critic's Ranking Alice's Ranking 


1 Saving Private Ryan 

2 Life is Beautiful 

3 Forrest Gump 

4 Braveheart 

5 Good Will Hunting 

6 Titanic 

7 Jurassic Park 


Life is Beautiful 
Saving Private Ryan 
Good Will Hunting 
Titanic 
Braveheart 
Forrest Gump 
Jurassic Park 


Dave studied the two rankings and listened carefully to Alice's rationale (which he 
felt was a bit over the top), but eventually, he held up the following diagram and offered 
it as a statement of those comparisons on which both Alice and the movie critic were 
in agreement. 

Do you see how Dave made up this diagram? Add your own rankings of these seven 
films and then draw the diagram that Dave would produce as a statement about the 
comparisons on which you, Alice and the movie critic were in agreement. 

More generally, when humans are asked to express preferences among a set of op- 
tions, they often report that establishing a totally ranked list is difficult if not impos- 
sible. Instead, they prefer to report a partial order — where comparisons are made be- 
tween certain pairs of options but not between others. In this chapter, we make these 
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Saving Private Ryan Life is Beautiful 



Figure 6.2: Top Movies from the 90's 


observations more concrete by introducing the concept of a partially ordered set. Ele- 
mentary examples include (1) a family of sets which is partially ordered by inclusion 
and (2) a set of positive integers which is partially ordered by division. From an ap- 
plications standpoint, a complex construction job typically involves a large number 
of projects for which there is a notion of precedence between some but not all pairs. 
Also, computer file systems are modeled by trees which become partially ordered sets 
whenever links are added. 


6.1 Basic Notation and Terminology 


A partially ordered set or poset P is a pair (X, P) where X is a set and P is a reflexive, 
antisymmetric, and transitive binary relation on X. (Refer to Section B. 10 for a refresher 
of what these properties are if you need to.) We call X the ground set while P is a 
partial order on X. Elements of the ground set X are also called points, and the poset 
P is finite if its ground set X is a finite set. 
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Example 6.3. Let X = {a,b,c, d, e, /}. Consider the following binary relations on X. 

Ri = {(«, a), (b, b ), (i c , c), (d, d), (e, e), (/, /), (a, fc), (a, c ), (e, /)} 

£2 = {(«, «), (&, b), (c, c), (d, d), (e, e), (/, /), (d, b), (d, e), (b, a), (e, a), 

( d,a),{c,f )} 

R 3 = {(«, «), (&, b), (c, c ), (d, d), (e, e), (/, /), (a, c), (a, e), (a,f), (b, c), 
(b / d) / (b,e),(b,f),(d,e) / (d / f),(e,f)} 

Ra = {(«, «), (&, b), (c, c ), (d, d), (e, e), (/, /), (d, b), (b, a), (e, a), (c, /)} 

R 5 = {(fl,fl),(c,c),(d,d),(e,e),(fl,e),(c,fl),(c,e),(d,e)} 

^6 = {(a, a), (&, fc), (c, c), (d, d), (e, e), (/, /), (d, /), (fe, e), (c, a), (e, &)} 

Which of the binary relations are partial orders on X? For those that are not partial 
orders on X, which property or properties are violated? 

Solution. A bit of checking confirms that R\, R 2 and R3 are partial orders on X, so 
Pi = (X, Ri), P2 = (X, R2) and P3 = (X, R3) are posets. Several of the other examples 
we will discuss in this chapter will use the poset P3 = (X, R3). 

On the other hand, R4, R5 and R(, are not partial orders on X. Note that R4 is not 
transitive, as it contains (d, b) and (b, a) but not (d, a). The relation R5 is not reflexive, 
since it doesn't contain (b, b). (Also, it also doesn't contain (/,/), but one shortcom- 
ing is enough.) Note that R5 is a partial order on {a, b, d, e}. The relation Rg is not 
antisymmetric, as it contains both (. b , e) and (e, b). 

When P = (X, P) is a poset, it is common to write x < y in P or y > x in P as 
substitutes for (x, y) e P. Of course, the notations x < y in P and y > x in P mean 
x < y in P and x + y . When the poset P remains fixed throughout a discussion, we will 
sometimes abbreviate x < y in P by just writing x < y, etc. When x and y are distinct 
points from X, we say x is covered by y in P 1 when x < yin P, and there is no point 
z e X for which x < z and z < 1/ in P. For example, in the poset P3 = (X, R3) from 
Example 6.3, d is covered by e and c covers b. Flowever, a is not covered by /, since 
a < e < f in R3. We can then associate with the poset P a cover graph G whose vertex 
set is the ground set X of P with xy an edge in G if and only if one of x and y covers the 
other in P. Again, for the poset P3 from Example 6 . 3 , we show the cover graph on the 
left side of Figure 6 . 4 . Actually, on the right side of this figure is just another drawing 
of this same graph. 


Reflecting the vagaries of the English language, mathematicians use the phrases: (1) x is covered by y in 
P; (2) y covers r in P; and (3) ( x , y) is a cover in P interchangeably. 
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Q / 



e 


e 


a 


d 


b 


Figure 6.4: Cover Graph 


It is convenient to illustrate a poset with a suitably drawn diagram of the cover graph 
in the Euclidean plane. We choose a standard horizontal/ vertical coordinate system 
in the plane and require that the vertical coordinate of the point corresponding to y be 
larger than the vertical coordinate of the point corresponding to x whenever y covers x 
in P. Each edge in the cover graph is represented by a straight line segment which con- 
tains no point corresponding to any element in the poset other than those associated 
with its two end points. Such diagrams are called Hasse diagrams (poset diagrams, 
order diagrams, or just diagrams). Now it should be clear that the drawing on the right 
side of Figure 6.4 is a diagram of the poset P 3 from Example 6.3, while the diagram on 
the left is not. 

For posets of moderate size, diagrams are frequently used to define a poset — rather 
than the explicit binary relation notation illustrated in Example 6.3. In Figure 6.5, we 
illustrate a poset P = (X, P) with ground set X = [17] = {1,2, . . . , 17}. It would take 
several lines of text to write out the binary relation P, and somehow the diagram serves 
to give us a more tactile sense of the properties of the poset. 

Discussion 6.6. Alice and Bob are talking about how you communicate with a com- 
puter in working with posets. Bob says that computers have incredible graphics capa- 
bilities these days and that you just give the computer a pdf scan of a diagram. Alice 
says that she doubts that anybody really does that. Carlos says that there are several 
effective strategies. One way is to label the points with positive integers from [/; ] where 
n is the number of points in the ground set and then define a 0-1 n X n matrix A with 
entry a(i, j) = 1 when i < j in P and a(i, j) = 0 otherwise. Alternatively, you can just 
provide for each element i in the ground set a vector if (x) listing all elements which 
are greater than x in P. This vector can be what computer scientists call a linked list. 

Example 6.7. There are several quite natural ways to construct posets. 
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Figure 6.5: A Poset on 17 Points 


1. A family (F of sets is partially ordered by inclusion, i.e., set A < B if and only if 
A is a subset of B. 

2. A set X of positive integers is partially ordered by division — without remainder, 
i.e., set m < n if and only if n = 0 (mod m). 

3. A set X of t -tuples of real numbers is partially ordered by the rule 

(a 1/ a 2 ,... l a t ) < (b lr b 2 , . ■ . , b t ) 

if and only if a; < b, in the natural order on R for i = 1,2, . . . , t. 

4. When Li, L 2/ . . . , L/ ( are linear orders on the same set X, we can define a partial 
order P on X by setting x < y in P if and only if x < y in L, for all i = 1,2, ... ,k. 

We illustrate the first three constructions with the posets shown in Figure 6.8. As is 
now clear, in the discussion at the very beginning of this chapter, Dave drew a diagram 
for the poset determined by the intersection of the linear orders given by Alice and the 
movie critic. 


12,3,5,7) (2,5,25) 



Figure 6.8: Constructing Posets 
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Distinct points x and y in a poset P = (X, P) are comparable if either x < y in P or 
x > y in P; otherwise x and y are incomparable. If x and y are incomparable in P, we 
sometimes write x \\y in P. With a poset P = (X, P), we associate a comparability graph 
Gi = (X, Ei) and an incomparability graph G 2 = (X,E 2 ). The edges in the compara- 
bility graph Gi consist of the comparable pairs and the edges in the incomparability 
graph are the incomparable pairs. We illustrate these definitions in Figure 6.9 where 
we show the comparability graph and the incomparability graph of the poset P3. 




/ 


d 



Figure 6.9: Comparability and Incomparability Graphs 


A partial order P is called a total order (also, a linear order) if for all x,y e X, either 
x < y in P or y < x in P. For small finite sets, we can specify a linear order by listing 
the elements from least to greatest. For example, L = \b,c,d,a, f, g,e] is the linear 
order on the ground set {a, b, c, d, e,f,g} with b < c < d < a < f < g < e mL. 

The set of real numbers comes equipped with a natural total order. For example, 
1 < 7/5 < V2 < n in this order. But in this chapter, we will be interested primarily with 
partial orders that are not linear orders. Also, we note that special care must be taken 
when discussing partial orders on ground sets whose elements are real numbers. For 
the poset shown in Figure 6.5, note that 14 is less than 8, while 3 and 6 are incomparable. 
Best not to tell your parents that you've learned that under certain circumstances, 14 
can be less than 8 and that you may be able to say which of 3 and 6 is larger than the 
other. The subtlety may be lost in the heated discussion certain to follow. 

When P = (X, P) is a poset and Y c X, the binary relation Q = P fl (Y X Y) is a partial 
order on Y, and we call the poset (Y, Q) a subposet of P. In Figure 6.10, we show a 
subposet of the poset first presented in Figure 6.5. 
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Figure 6.10: A Subposet 


When P = (X, P) is a poset and C is a subset of X, we say that C is a chain if every 
distinct pair of points from C is comparable in P. When P is a linear order, the entire 
ground set X is a chain. Dually, if A is a subset of X, we say that A is an antichain 
if every distinct pair of points from A is incomparable in P. Note that a one-element 
subset is both a chain and an antichain. Also, we consider the empty set as both a chain 
and an antichain. 

The height of a poset P = (X, P), denoted height(P) , is the largest h for which there 
exists a chain of h points in P. Dually, the width of a poset P = (X, P), denoted width(P) 
, is the largest zv for which there exists an antichain of zv points in P. 

Discussion 6.11. Given a poset P = (X, P), how hard is to determine its height and 
width? Bob says that it is very easy. For example, to find the width of a poset, just list 
all the subsets of X. Delete those which are not anti chains. The answer is the size of the 
largest subset that remains. He is quick to assert that the same approach will work to 
find the height. Alice groans at Bob's naivety and suggests that he should read further 
in this chapter. 


6.2 Additional Concepts for Posets 

We say (X, P) and (Y, Q) are isomorphic, and write (X, P) = (Y, Q) if there exists a 
bijection (1-1 and onto map) f : X —* Y so that i' i < X 2 in P if and only if f(x i) < f(x 2 ) 
in Q. In this definition, the map / is called an isomorphism from P to Q. In Figure 6.8, 
the first two posets are isomorphic. 

Discussion 6.12. Bob sees a pattern linking the first two posets shown in Figure 6.8 and 
asserts that any poset of one of these two types is isomorphic to a poset of the other 
type. Alice admits that Bob is right — but even more is true. The four constructions 
given in Example 6.7 are universal in the sense that every poset is isomorphic to a poset 
of each of the four types. Do you see why? If you get stuck answering this, we will 
revisit the question at the end of the chapter, and we will give you a hint. 
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An isomorphism from P to P is called an automorphism of P. An isomorphism 
from P to a subposet of Q is called an embedding of P in Q. In most settings, we will 
not distinguish between isomorphic posets, and we will say that a poset P = (X, P) is 
contained in Q = (Y, Q) (also Q contains P) when there is an embedding of P in Q. 
Also, we will say that P excludes Q when no subposet of P is isomorphic to Q, and we 
will frequently say P = Q when P and Q are isomorphic. 

With the notion of isomorphism, we are lead naturally to the notion of an "unla- 
beled" posets, and in Figure 6.13, we show a diagram for such a poset. 



Figure 6.13: An Unlabeled Partially Ordered Set 

Discussion 6.14. How hard is it to tell whether two posets are isomorphic? Bob thinks 
it's not too difficult. Bob says that if you give him a bijection between the ground sets, 
then he can quickly determine whether you have established that the two posets are 
isomorphic. Alice senses that Bob is confusing the issue of testing whether two posets 
are isomorphic with simply verifying that a particular bijection can be certified to be 
an isomorphism. The first problem seems much harder to her. Carlos says that he 
thinks it's actually very hard and that in fact, no one knows whether there is a good 
algorithm. 

Note that the poset shown in Figure 6.13 has the property that there is only one 
maximal point. Such a point is sometimes called a one, denoted not surprisingly as 1. 
Also, there is only one minimal point, and it is called a zero, denoted 0. 

The dual of a partial order P on a set X is denoted by P d and is defined by P d = 
{(y, x ) : (x, y) e P}. The dual of a poset P = (X, P) is denoted by P d and is defined by 
P d = (X, P d ). A poset P is self-dual if P = P rf . 

A poset P = (X, P) is connected if its comparability graph is connected, i.e., for every 
x, y e X with x + y, there is a finite sequence x = xo, x\, ... ,x n = y of points from 
X so that x; is comparable to x;+i in P for i = 0, 1, 2, . . . , n - 1. A subposet (Y, P(Y)) 
of (X, P) is called a component of P if (Y, P(Y)) is connected and there is no subset 
Z C X containing Y as a proper subset for which (Z, P(Z)) is connected. A one-point 
component is trivial (also, a loose point or isolated point); components of two or more 
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points are nontrivial. Note that a loose point is both a minimal element and a maximal 
element. Returning to the poset shown in Figure 6.5, we see that it has two components. 

It is natural to say that a graph G is a comparability graph when there is a poset 
P = (X,P) whose comparability graph is isomorphic to G. For example, we show in 
Figure 6.15 a graph on 6 vertices which is not a comparability graph. (We leave the 
task of establishing this claim as an exercise.) 



Figure 6.15: A Graph Which is Not a Comparability Graph 

Similarly, we say that a graph G is a cover graph when there exists a poset P = (X, P ) 
whose cover graph is isomorphic to G. Not every graph is a cover graph. In particular, 
any graph which contains a triangle is not a cover graph. In the exercises at the end 
of the chapter, you will be asked to construct triangle-free graphs which are not cover 
graphs — with some hints given as to how to proceed. 

Discussion 6.16. Bob is quite taken with graphs associated with posets. Fie makes the 
following claims. 

1. Only linear orders have paths as cover graphs. 

2. A poset and its dual have the same cover graph and the same comparability 
graph. 

3. Any two posets with the same cover graph have the same height and the same 
width. 

4. Any two posets with the same comparability graph have the same height and the 
same width. 

Alice shrugs and says that Bob is right half the time. Which two assertions are cor- 
rect? 

Undeterred, Bob notes that the comparability graph shown in Figure 6.9 is also an 
incomparability graph (for another poset). Fie goes on to posit that this is always true. 
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i.e., whenever G is the comparability graph of a poset P, there is another poset Q for 
which G is the incomparability graph of Q. Alice says that Bob is right on the first 
count but she is not so sure about the second. Dave mumbles that they should take a 
look at the comparability graph of the third poset in Figure 6.8. This graph is not an 
incomparability graph. But in his typical befuddled manner, Dave doesn't offer any 
justification for this statement. Can you help Alice and Bob to see why Dave is correct? 

Bob is on a roll and he goes on to suggest that it is relatively easy to determine 
whether a graph is a comparability graph (he read it on the web), but he has a sense 
that determining whether a graph is a cover graph might be difficult. Do you think he 
is right — on either count? 

6.3 Dilworth’s Chain Covering Theorem and its Dual 

In this section, we prove the following theorem of R.P. Dilworth, which is truly one of 
the classic results of combinatorial mathematics. 

Theorem 6.17 (Dilworth's Theorem). If P = (X, P) is a poset and width(P) = zv, then 
there exists a partition X = C\ U C 2 U • ■ ■ U C w , where Ci is a chain for i = 1,2, ... , zv. 
Furthermore, there is no chain partition into fewer chains. 

Before proceeding with the proof of Dilworth's theorem in Subsection 6.3.1, we 
pause to discuss the dual version for partitions into antichains, as it is even easier to 
prove. 

Theorem 6.18 (Dual of Dilworth's Theorem). If P = (X, P) is a poset and height(P) = h, 
then there exists a partition X = AiUy^U- • -U A;„ where Aj is an antichain for i = 1,2, . . . ,h. 
Furthermore, there is no partition using fewer antichains. 

Proof. For each x E X, let height(x) be the largest integer t for which there exists a 
chain 

X\ < X2 < ■ ■ ■ < X t 

with x = x t . Evidently, height(x) < h for all x E X. Then for each i = 1,2,..., h, 
let A; = {x E X : height(x) = i } . It is easy to see that each A, is an antichain, as if 
x, y E Aj are such that x < y, then there is a chain Xi < X 2 < ■ ■ • < x; = x < x;+; = y, so 
height(y) > i + 1. Since height(P) = h, there is a maximum chain C = {xi, X 2 , . . . , X/,}. 
If it were possible to partition P into t < h antichains, then by the Pigeon Hole Principle, 
one of the antichains would contain two points from C, but this is not possible. □ 

When P = (X, P) is a poset, a point x E X with height(x) = 1 is called a minimal 
point of P. We denote the set of all minimal points of a poset P = (X, P) by min(X, P). 1 

1 Since we use the notation P = (X, P) for a poset, the set of minimal elements can be denoted by min(P) or 
min(X, P). This convention will be used for all set valued and integer valued functions of posets. 
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The argument given for the proof of Theorem 6.18 yields an efficient algorithm, one 
that is defined recursively. Set Po = P. If P, has been defined and P, + ill, let A, = 
min(P, ) and then let P; + i denote the subposet remaining when A, is removed from P, . 

In Figure 6.19, we illustrate the antichain partition provided by this algorithm for 
the 17 point poset from Figure 6.5. The darkened points form a chain of size 5. 



Discussion 6.20. Alice claims that it is very easy to find the set of minimal elements 
of a poset. Do you agree? 

Dually, we can speak of the set max(P) of maximal points of P. We can also partition 
P into height(P) anti chains by recursively removing the set of maximal points. 

We pause to remark that when P = (X, P) is a poset, the set of all chains of P is itself 
partially ordered by inclusion. So it is natural to say that a chain C is maximal when 
there is no chain C containing C as a proper subset. Also, a chain C is maximum 
when there is no chain C' with |C| < |C'|. Of course, a maximum chain is maximal, 
but maximal chains need not be maximum. 

Maximal antichains and maximum antichains are defined analogously. 

With this terminology, the thrust of Theorem 6.18 is that it is easy to find the height 
h of a poset as well as a maximum chain C consisting of h points from P. Of course, 
we also get a handy partition of the poset into h antichains. 

6.3.1 Proof of Dilworth’s Theorem 

The argument for Dilworth's theorem is simplified by the following notation. When 
P = ( X,P ) is a poset and x e X, we let D(x) = {y e X : y < x in P}; D[x] = {y e 
X : y < xinP}; U(x) = {y e X : y > xinP}; lT[x] = {y e X : y > x}; and 
I(x) = {y e X - {x} : x\\y in P}. When S c X, we let D(S) = {y e X : y < x in P, for 
some x e S} and D[S] = S U D(S). The subsets U(S) and lf[S] are defined dually. We 
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call D(x), D[x], D(s), and D[S] down sets, while U(x), U[x], lf(s), and U[S] are up 
sets. Note that when A is a maximal antichain in P, the ground set X can be partitioned 
into pairwise disjoint sets as X = A U D(A) U lf(A). 

We are now ready for the proof. Let P = (X, P) be a poset and let iv denote the 
width of P. As in Theorem 6.18, the Pigeon Hole Principle implies that we require 
at least iv chains in any chain partition of P. To prove that zv suffice, we proceed by 
induction on |X|, the result being trivial if |X| = 1. Assume validity for all posets with 
|X| < k and suppose that P = (X,P) is a poset with |X| = k + 1. Without loss of 
generality, w > 1; otherwise, the trivial partition X = Ci satisfies the conclusion of the 
theorem. Furthermore, we observe that if C is a (nonempty) chain in (X, P), then we 
may assume that the subposet (X - C, P(X - C)) also has width zv. To see this, observe 
that the theorem holds for the subposet, so that if width(X — C,P(X — C)) = zv' < zv, 
then we can partition X-CasX-C = Ci U C 2 U • • • U C W ' , so that X = C U Ci U • • • U C W ' 
is a partition into zv' + 1 chains. Since zv' < zv, we know zv' + 1 < zv, so we have a 
partition of X into at most zv chains. Since any partition of X into chains must use at 
least zv chains, this is exactly the partition we seek. 

Choose a maximal point x and a minimal point y with y < x in P. Then let C be 
the chain containing only the points x and y. Note that C contains either one or two 
elements depending on whether x and y are distinct. 

Let Y = X - C and Q = P(Y) and let A be a re-element antichain in the subposet 
(Y, Q). In the partition X = A U D(A) U It (A), the fact that y is a minimal point while 
A is a maximal antichain imply that y e D(A). Similarly, x e It (A). In particular, this 
shows that x and y are distinct. 

Label the elements of A as {a\, fl 2 , . . . ,a w }. Note that If [A] + X since y i U [A], and 
D[A] + X since x i D[A]. Therefore, we may apply the inductive hypothesis to the 
subposets of P determined by D[A] and If [A], respectively, and partition each of these 
two subposets into zv chains: 


If [A] = Ci U C 2 U • • • U C w and D[A] = D x U D 2 U • • • U D ro . 

Without loss of generality, we may assume these chains have been labeled so that a, e 
Ci fl D, for each i = 1,2,..., zv. However, this implies that 


X = (Ci U Di) U (C 2 U D 2 ) U • • • U (C w U D w ) 


is the desired partition which in turn completes the proof. 

In Figure 6.21, we illustrate Dilworth's chain covering theorem for the poset first 
introduced in Figure 6.5. The darkened points form a 7-element antichain, while the 
labels provide a partition into 7 chains. 


124 


6.4 Linear Extensions of Partially Ordered Sets 



Figure 6.21: A Poset of Width 7 

Discussion 6.22. The ever alert Alice notes that the proof given above for Dilworth's 
theorem does not seem to provide an efficient algorithm for finding the width w of 
a poset, much less a partition of the poset into w chains. Bob has yet to figure out 
why listing all the subsets of X is a bad idea. Carlos is sitting quietly listening to their 
bickering, but finally, he says that a skilled programmer can devise an algorithm from 
the proof. Students are encouraged to discuss this dilemma — but rest assured that we 
will return to this issue later in the text. 


6.4 Linear Extensions of Partially Ordered Sets 


Let P = (X, P) be a partially ordered set. A linear order L on X is called a linear 
extension (also, a topological sort) of P, if x < y in L whenever x < y in P. For 
example, the table displayed in Figure 6.23 shows that our familiar example P 3 has 11 
linear extensions. 



Figure 6.23: A poset and its linear extensions 
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Discussion 6.24. Bob says that he is not convinced that every finite poset has a linear 
extension. Alice says that it is easy to show that they do. Is she right? 

Carlos says that there are subtleties to this question when the ground set X is in- 
finite. You might want to do a web search on the name Szpilrajn and read about his 
contribution to this issue. 

The classical sorting problem studied in all elementary computer science courses is 
to determine an unknown linear order L of a set X by asking a series of questions of 
the form: Is x < y in L? All the well known sorting algorithms (bubble sort, merge 
sort, quick sort, etc.) proceed in this manner. 

Here is an important special case: determine an unknown linear extension L of a 
poset P by asking a series of questions of the form: Is x < y in L? 

Discussion 6.25. Given the poset P = (X, P) shown in Figure 6.5 and the problem 
of determining an unknown linear extension of P, how should Alice decide which 
question (of the form: Is x < y in L?) to ask? 

How would you like to be assigned to count the number of linear extensions of this 
poset? In general, how hard is it to determine the number of linear extensions of a 
poset? Could you (and your computer) do this count for a poset on 100, 000 points? 

6.5 The Subset Lattice 

When X is a finite set, the family of all subsets of X, partially ordered by inclusion, 
forms a subset lattice 1 . We illustrate this in Figure 6.26 where we show the lattice of 
all subsets of (1, 2, 3, 4}. In this figure, note that we are representing sets by bit strings, 
and we have further abbreviated the notation by writing strings without commas and 
parentheses. 

For a positive integer f, we let 2 1 denote the subset lattice consisting of all subsets of 
{1,2 , ,t} ordered by inclusion. Some elementary properties of this poset are: 

1. The height is t + 1 and all maximal chains have exactly t + 1 points. 

2. The size of the poset 2 l is 2 f and the elements are partitioned into ranks (an- 
tichains) Aq,A\, . . . , A t with \Ai\ = (J) for each i = 0, 1, . . . , t. 

3. The maximum size of a rank in the subset lattice occurs in the middle, i.e. if 
s = [t/2], then the largest binomial coefficient in the sequence Q, ( j), ( 2 ), •■■,([) 
is ( ). Note that when t is odd, there are two ranks of maximum size, but when t 
is even, there is only one. 

1 A lattice is a special type of poset. You do not have to concern yourself with the definition and can safely 

replace "lattice" with "poset" as you read this chapter. 
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0000 


Figure 6.26: A Subset Lattice 

6.5.1 Sperner’s Theorem 

For the width of the subset lattice, we have the following classic result of Sperner. 

Theorem 6.27 (Sperner's Theorem). For each t > 1, the width of the subset lattice 2 { is the 
maximum size of a rank, i.e., 

width < 2' ) =( l ; j ) 

Proof. The width of the poset 2 1 is at least C(f, |_jJ) since the set of all L -element 
subsets of {1,2, . . . , t } is an anti chain. We now show that the width of 2 f is at most 

c(t, L|J). 

Let w be the width of 2 1 and let {Si, S 2 , . . . , S zv } be an antichain of size w in this 
poset, i.e., each S, is a subset of {1,2, . . . , f} and if 1 < i < j < w, then S, $£ Sj and 
Sj t Si- 

For each i, consider the set S, of all maximal chains which pass through S;. It is easy 
to see that if |S,| = kj, then |«S;| = kj\(t - kf)\. This follows from the observation that 
to form such a maximum chain beginning with S; as an intermediate point, you delete 
the elements of S, one at a time to form the sets of the lower part of the chain. Also, to 
form the upper part of the chain, you add the elements not in S, one at a time. 

Note further that if 1 < i < j < w, then Sj fl Sj = 0, for if there was a maximum 
chain belonging to both Sj and Sj, then it would imply that one of S; and S ; is a subset 
of the other. 
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Altogether, there are exactly f! maximum chains in 2 f . This implies that 


This implies that 


It follows that 
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6.6 Interval Orders 

When we discussed Dilworth's Theorem, we commented that the algorithmic aspects 
would be deferred until later in the text. But there is one important class of orders for 
which the full solution is easy to obtain. 

A poset P = (X, P) is called an interval order if there exists a function I assigning to 
each element x e X a closed interval I(x) = [a x , b x ] of the real line R so that for all x, 
y e X, x < y in P if and only if b x < a y inR. We call I an interval representation of P, or 
just a representation for short. For brevity, whenever we say that I is a representation 
of an interval order P = (X, P), we will use the alternate notation [a x , b x ] for the closed 
interval l(x). Also, we let |f(x)| denote the length of the interval, i.e., |f(x)| = b x - a x . 
Returning to the poset P3, the representation shown in Figure 6.28 shows that it is an 
interval order. 

Note that end points of intervals used in a representation need not be distinct. In 
fact, distinct points x and y from X may satisfy I(x) = I(y). We even allow degenerate 
intervals, i.e., those of the form [a, a]. On the other hand, a representation is said to be 
distinguishing if all intervals are non-degenerate and all end points are distinct. It is 
relatively easy to see that every interval order has a distinguishing representation. 

As we shall soon see, interval orders can be characterized succinctly in terms of for- 
bidden subposets. Before stating this characterization, we need to introduce a bit more 
notation. By n (for n > 1 an integer), we mean the chain with n points. More precisely. 
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Figure 6.28: An interval order and its representation 


we take the ground set to be {0, 1, . . . , n - 1} with i < j in n if and only if i < j in Z. 
If P = (X, P) and Q = (Y, Q) are posets with X and Y disjoint, then P + Q is the poset 
R = (X U Y, R) where the partial order is given by 2 < w i n R if and only if (a )z,w £ X 
and z < w in P or (b) z, iv £ Y and z < w in Q. Thus, n + m consists of a chain with n 
points and a chain with m points and no comparabilities between them. In particular, 
2 + 2 can be viewed as a four-point poset with ground set {a, b, c, d} and a < b and 
c < d as the only relations (other than those required to make the relation reflexive). 

Theorem 6.29 (Fishburn's Theorem). Let P = (X, P) be a poset. Then P is an interval order 
if and only if it excludes 2 + 2. 

Proof. We show only that an interval order cannot contain a subposet isomorphic to 
2 + 2, deferring the proof in the other direction to the next section. Now suppose that 
P = (X, P) is a poset, {x, y,z,iv} c X and the subposet determined by these four 
points is isomorphic to 2 + 2. We show that P is not an interval order. Suppose to the 
contrary that I is an interval representation of P. Without loss of generality, we may 
assume that x < y and z < w in P. Thus x\\zv and z||y in P. Then b x < a y and b~ < a w 
in R so that a w < b x < a XJ < b z , which is a contradiction. □ 

6.7 Finding a Representation of an Interval Order 

In this section, we develop an algorithm for finding an interval representation of an 
interval order. In fact, this algorithm can be applied to any poset. Either it will find an 
interval representation or it will find a subposet isomorphic to 2 + 2. Asa consequence, 
we establish the other half of Fishburn's Theorem. 


129 


Chapter 6 Partially Ordered Sets 


When P = (X, P) is an interval order and n is a positive integer, there may be many 
different ways to represent P using intervals with integer end points in [n]. But there 
is certainly a least n for which a representation can be found, and here we see that 
the representation is unique. The discussion will again make use of the notation for 
down sets and up sets that we introduced prior to the proof of Dilworth's Theorem. 
As a reminder, we repeat it here. For a poset P = (X, P) and a subset S c X, let 
D(S) = {y £ X : there exists some x £ S with y < x in P}. Also, let D[S] = D(S) U S. 
When |S| = 1, say S = {x}, we write D(x) and D[x] rather than D({x}) and D[{x}]. 
Dually, for a subset S c X, we define lf(S) = {yeX: there exists some x e X with 
y > x in P}. As before, set U[S] = U(S) U S. And when S = {x}, we just write U(x) 
for {y £ X : x < y in P}. 

Let P = (X, P) be a poset. We start our procedure by finding the following subsets 
of the ground set: ID = (D(x) : x £ X}. We then distinguish two cases. In the first 
case, there are distinct elements x and y for which D(x) $£ D(y) and D(y ) $£ D(x). In 
this case, we choose an element z £ D(x) - D(y ) and an element zv £ D(y) - D(x). It 
follows that the four elements in {x, y, z, zv} form a subposet of P which is isomorphic 
to 2 + 2. 

Our second case is that either D(x) c D(y) or D(y) c D(x) for all x, y £ X. In 
this case, we will show that P is an interval order. Now find the family: Id = { l/(x) : 
x £ X}. In this case, it is easy to see that we will always have either U(x) C 11 ( y ) or 
If(y) c Lf(x) for all x, yeX. 

Let d = \D\. In the exercises, we will provide (actually in doing your homework, you 
will provide) the details for backing up the following statement: |'ZY| = \D\, so for now 
we assume that this statement is valid. Label the sets in T) and tl respectively as Di, 
D2 , . . . , Drf and l/|, U 2 , ... ,Ud so that 

0 = Di c D2 c D3 c ■ ■ ■ c Drf and 


lil D li 2 • • • D lfrf-2 3 U d - 1 3 • • • 3 U d = 0. 

We form an interval representation I of P by the following rule: For each x £ X, set 
f(x) = [z, j], where D(x) = D, and U(x) = Uj. It is not immediately clear that this rule 
is legal, i.e., it might happen that applying the rule results in values of i and j for which 
j < i. But again, as a result of the exercises, we will see that this never happens. This 
collection of exercises is summarized in the following theorem. 

Theorem 6.30. If P is a poset excluding 2 + 2, then the follozving statements hold. 

1. The number ofdozvn sets equals the number of up sets. That is, \D\ = YU\. 

2. For each x £ X, ifl(x) = [i, j], then i < j in R. 
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3. For each x, y e X, ifl{x) = \i, j\ and I(y) = [k, l], then x < y in P if and only if j < k 
in R 

4. The integer d is the least positive integer for which P has an interval representation using 
integer end points from [d]. This representation is unique. 

Consider the poset shown in Figure 6.31. 



Figure 6.31: An interval order on 10 Points 


Then d = 5 with Di = 0, D 2 = { c }, D 3 = {c,f,y}, D 4 = { c, f,g,h }, and D 5 = 
{a,c,f,g,h,j}. Also lb = {a,b,d,e,h,i, j}, U 2 = { a / b,e,h,i,j }, U 3 = {b,e,i}, lf 4 = 
{e}, and U5 = 0. So 

1(a) = [3,4] 1(b) = [4,5] 1(c) = [1,1] 1(d) = [2,5] 1(e) = [5,5] 

1(f) = [1/2] 1(g) = [1,2] 1(h) = [3,3] 1(0 = [4,5] I(j) = [ 3,4] 

To illustrate the situation where this process can be used to determine when a poset 
is not an interval order, consider again the poset shown in Figure 6.31. Erase the line 
joining points c and d. For the resulting poset, you will then find that D(j) = {/, g} 
and D(d) = {c}. Therefore, the four points c, d, f and j form a copy of 2 + 2 in this 
modified poset. 

6.8 Dilworth’s Theorem for Interval Orders 

As remarked previously, we do not yet have an efficient process for determining the 
width of a poset and a minimum partition into chains. For interval orders, there is 
indeed a simple way to find both. The explanation is just to establish a connection 
with coloring of interval graphs as discussed in Chapter 5. 

Let P = (X, P) be an interval order and let {[a x , b x ] : x e X} be intervals of the real 
line so that x < y in P if and only b x < a lr Then let G be the interval graph determined 
by this family of intervals. Note that if x and y are distinct elements of X, then x and 


131 


Chapter 6 Partially Ordered Sets 


y are incomparable in P if and only if xy is an edge in G. In other words, G is just the 
incomparability graph of P. 

Recall from Chapter 5 that interval graphs are perfect, i.e., ,y(G) = oj(G) for every 
interval graph G. Furthermore, you can find an optimal coloring of an interval graph 
by applying first fit to the vertices in a linear order that respects left end points. Such 
a coloring concurrently determines a partition of P into chains. 

In fact, if you want to skip the part about interval representations, take any linear 
ordering of the elements as x\, X2 , . . . , x n so that i < j whenever D(x ) is a proper subset 
of D(y). Then apply First Fit with respect to chains. For example, using the 10 point 
interval order illustrated in Figure 6.31, here is such a labeling: 

x\ = g X2 = f x 3 = c X4 = d X5 = h 

X(, = a X7 = j xg = b xg = i xw = e 

Now apply the First Fit algorithm to the points of P, in this order, to assign them to 
chains Ci, C2 , .... In other words, assign x\ to chain Ci. Thereafter if you have assigned 
points X\, X2, ■ ■ ■ , Xj to chains, then assign x, + i to chain C , where j is the least positive 
integer for which Xj + 1 is comparable to xy whenever 1 < k < i and x^ has already been 
assigned to C , . For example, this rule results in the following chains for the interval 
order P shown in Figure 6.31. 


Ci = {g,h,b} 

C 2 = {f ,a,e} 

C 3 = {c,d} 

c 4 = {/} 
c 5 = {i} 

In this case, it is easy to see that the chain partition is optimal since the width of P is 5 
and A = {a, b, d, i, j} is a 5-element antichain. 

Flowever, you should be very careful in applying First Fit to find optimal chain par- 
titions of posets — just as one must be leary of using First Fit to find optimal colorings 
of graphs. 

Example 6.32. The poset on the left side of Figure 6.33 is a height 2 poset on 10 points, 
and if the poset is partitioned into antichains by applying First Fit and considering the 
points in the order of their labels, then 5 antichains will be used. Do you see how to 
extend this poset to force First Fit to use arbitrarily many antichains, while keeping the 
height of the poset at 2? 

On the right side, we show a poset of width 2. Now if this poset is partitioned into 
chains by applying First Fit and considering the points in the order of their labels, then 
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4 chains will be used. Do you see how to extend this poset to force First Fit to use 
arbitrarily many chains while keeping the width of the poset at 2? 

Do you get a feeling for why the second problem is a bit harder than the first? 




Figure 6.33: Flow First Fit Can Go Wrong 


In general, there is always some linear order on the ground set of a poset for which 
First Fit will find an optimal partition into antichains. Also, there is a linear order (in 
general different from the first) on the ground set for which First Fit will find an optimal 
partition into chains. Flowever, there is no advantage in searching for such orders, as 
the algorithms we develop for finding optimal antichain and chain partitions work 
quite well. 


6.9 Discussion 

Over coffee. Bob said that he really liked this chapter. "This material was full of cases 
of very concrete procedures for doing useful things. I like that." Yolanda offered a 
somewhat different perspective "On the other hand, this last procedure only seems to 
work with interval orders and we still don't have a clue as to how to find the width of 
a poset in the general case. This might be very difficult — like the graph coloring prob- 
lems discussed in the last chapter." Dave weighed in with "Somehow I think there's 
going to be a fairly efficient process that works for all posets. We may not have all the 
tools yet, but let's wait a bit." 

Not much was said for a while and after a pause, Carlos ventured that there were 
probably a lot of combinatorial problems for posets that had analogous versions for 
graphs and in those cases, the poset version would be a bit more complicated, some- 
time a little bit and sometimes a very big bit. Zori was quiet but she was thinking. 
These poset structures might even be useful, as she could imagine many settings in 
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which a linear order was impossible or impractical. Maybe there were ways here to 
earn a few dollars. 


6.10 Exercises 

1. We say that a relation R on a set X is symmetric if (x, y) e R implies (y, x) e R for 
all x, y e X. If X = {a, b, c, d, e, /}, how many symmetric relations are there on X? 
How many of these are reflexive? 

2. A relation R on a set X is an equivalence relation if R is reflexive, symmetric, and 
transitive. Fix an integer m > 2. Show that the relation defined on the set Z of integers 
by aRb ( a,b e Z) if and only if a = b (mod m) is an equivalence relation. (Recall 
that a = b (mod m) means that when dividing a by m and b by m you get the same 
remainder.) 

3. Is the binary relation 

P = {{ 1, 1), (2, 2), (3, 3), (4, 4), (1,3), (2, 4), (2, 5), (4, 5), (3, 5), (1,5)} 

a partial order on the set X = {1, 2, 3, 4, 5}? If so, discuss what properties you verified 
and how. If not, list the ordered pairs that must be added to P to make it a partial order 
or say why it cannot be made a partial order by adding ordered pairs. 

4. Draw the diagram of the poset P = (X,P) where X = {1,2,3,5,6,10,15,30} and 
x < y in P if and only if x|y. (Recall that x\y means that x evenly divides y without 
remainder. Equivalently x|y, if and only if y = 0 (mod x).) 

5. Draw the diagram of the poset P = (X, P) where 

X = {{1,3,4, 5, 6}, {1,2,4, 5, 6}, {1,2, 3, 6}, {1,2, 3}, {1,5,6}, 

{1,3,6}, {1,2}, {1,6}, {3,5}, {1}, {3}, {4}} 

and P is the partial order on X given by the "is a subset of" relationship. 

6. A linear extension of a poset P = (X,P) is a total order L on X such that if x < y 
in P, then x < y in L. Give linear extension of the three posets shown in Figure 6.8. If 
you feel very ambitious, try to count the number of linear extensions of the poset on 
the left side of the figure. Don't list them. Just provide an integer as your answer. 

7. Alice and Bob are considering posets P and Q. They soon realize that Q is isomor- 
phic to P rf . After 10 minutes of work, they figure out that P has height 5 and width 3. 
Bob doesn't want do find the height and width of Q, since he figures it will take (at 
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least) another 10 minutes to answer these questions for Q. Alice says Bob is crazy and 
that she already knows the height and width of Q. Who's right and why? 

8. For this exercise, consider the poset P in Figure 6.5. 

(a) List the maximal elements of P. 

(b) List the minimal elements of P. 

(c) Find a maximal chain with two points in P. 

(d) Find a chain in P with three points that is not maximal. Say why your chain is not 
maximal. 

(e) Find a maximal antichain with four points in P. 

9. Find the height h of the poset P = (X, P) shown below as well as a maximum chain 
and a partition of X into h antichains using the algorithm from this chapter. 



10. For each of the two distinct (up to isomorphism) posets in Figure 6.8, find the 
width w, an antichain of size w, and a partition of the ground set into u: chains. 

11. A restaurant chef has designed a new set of dishes for his menu. His set of dishes 
contains 10 main courses, and he will select a subset of them to place on the menu 
each night. To ensure variety of main courses for his patrons, he wants to guarantee 
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that a night's menu is neither completely contained in nor completely contains another 
night's menu. What is the largest number of menus he can plan using his 10 main 
courses subject to this requirement? 

12. Draw the diagram of the interval order represented in Figure 6.34. 


Y 



1 Y 
H 


H 

1 


1 


Figure 6.34: An interval representation 


13. Draw the diagram of the interval order represented in Figure 6.35. 


Y 



1 




e_ 

Y 

Y- 
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1 


Figure 6.35: An interval representation 


14. Find an interval representation for the poset in Figure 6.36 or give a reason why 
one does not exist. 



Figure 6.36: Is this poset an interval order? 
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15 . Find an interval representation for the poset in Figure 6.37 or give a reason why 
one does not exist. 



Figure 6.37: Is this poset an interval order? 


16 . Find an interval representation for the poset in Figure 6.38 or give a reason why 
one does not exist. 



17 . Find an interval representation for the poset in Figure 6.39 or give a reason why 
one does not exist. 
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3 



Figure 6.39: Is this poset an interval order? 


18. Use the First Fit algorithm (ordering by left endpoints) to find the width w of the 
interval order shown in Figure 6.40 and a partition into w chains. Also give an antichain 
with zv points. 


I 1 


H I 

-2 1 

-H I — ■ — -I 
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m 


\— 1 

Figure 6.40: An interval representation 


19. Complete the proof of Theorem 6.30. 

Hint. The key idea is to show that if d is the least positive integer for which an interval 
order P has a representation using end points from {1,2 , ,n}, then every integer i 
from this set must be both a left end point and a right end point of an interval. 

20. Show that every poset is isomorphic to a poset of each of the four types illustrated 
in Example 6.7. 

Hint. For each element x, choose some unique identifying key which is an elemen- 
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t/prime/coordinate/observer. Then associate with x a structure that identifies the 
keys of elements from D[x], 

21. The dimension of a poset P = ( X,P ), denoted dim(P), is the least t for which P is 
the intersection of t linear orders on X. 

(a) Show that the dimension of a poset P is the same as the dimension of its dual. 

(b) Show that P is a subposet of Q, then dim(P) < dim(Q). 

(c) Show that the removal of a point can reduce the dimension by at most 1. 

(d) Find the dimension of the posets in Figure 6.8. 

(e) Use Dilworth's theorem to show that the dimension of a poset is at most its width. 

(f) Use the example on the left side of Figure 6.33 to show that for every n > 2, there 
exists a poset P„ on 2 n points having width and dimension equal to n . 
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CHAPTER 


Inclusion-Exclusion 


In this chapter, we study an enumeration technique known as Inclusion-Exclusion. In 
its simplest case, it is absolutely intuitive. Its power rests in the fact that in many situa- 
tions, we start with an exponentially large calculation and see it reduce to a manageable 
size. We focus on three applications that every student of combinatorics should know: 
(1) counting surjections, (2) derangements, and (3) the Euler (^-function. 


7.1 Introduction 

We start this chapter with an elementary example. 

Example 7.1. Let X be the set of 63 students in an applied combinatorics course at 
a large technological university. Suppose there are 47 computer science majors and 
51 male students. Also, we know there are 45 male students majoring in computer 
science. How many students in the class are female students not majoring in computer 
science? 

Solution. Although the Venn diagrams that you've probably seen drawn many times 
over the years aren't always the best illustrations (especially if you try to think with 
some sort of scale), let's use one to get started. In Figure 7.2, we see how the groups in 
the scenario might overlap. 

Now we can see that we're after the number of students in the white rectangle but 
outside the two shaded ovals, which is the female students not majoring in computer 
science. To compute this, we can start by subtracting the number of male students (the 
blue region) from the total number of students in the class and then subtracting the 
number of computer science majors (the yellow region). However, we've now sub- 
tracted the overlapping region (the male computer science majors) twice, so we must 
add that number back. Thus, the number of female students in the class who are not 
majoring in computer science is 


63-51 -47 + 45 = 10. 
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Figure 7.2: A Venn diagram for an applied combinatorics class 


Example 7.3. Another type of problem where we can readily see how such a technique 
is applicable is a generalization of the problem of enumerating integer solutions of 
equations. In Chapter 2, we discussed how to count the number of solutions to an 
equation such as 

X\ + X2 + X 3 + X 4 = 100, 

where x\ > 0, xi, X 3 > 0 and 1 < x\ < 10. However, we steered clear of the situation 
where we add the further restriction that X 3 < 7. The previous example suggests a way 
of approaching this modified problem. 

First, let's set up the problem so that the lower bound on each variable is of the form 
Xj > 0. This leads us to the revised problem of enumerating the integer solutions to 

x\ + X 2 + *3 + = 97 

with x' v X2, X3, x ^ > 0, X3 < 7, and x ^ < 8 . (We'll then have x\ = x' x + 1 and x\ = x' 4 + 2 
to get our desired solution.) To count the number of integer solutions to this equation 
with X 3 < 7 and x' < 8, we must exclude any solution in which X 3 >> 7 or x' A >8. 
There are C(92, 3) solutions with X 3 > 7, and the number of solutions in which x' > 8 
is C(91, 3). At this point, it might be tempting to just subtract C(92, 3) and C(91, 3) from 
C(100, 3), the total number of solutions with all variables nonnegative. However, care 
is required. If we did that, we would eliminate the solutions with both X 3 >7 and 
x' > 8 twice. To account for this, we notice that there are C(83, 3) solutions with both 
X 3 > 7 and x' > 8 . If we add this number back in after subtracting, we've ensured that 
the solutions with both X 3 > 7 and x^ > 8 are not included in the total count and are 
not excluded more than once. Thus, the total number of solutions is 
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From these examples, you should start to see a pattern emerging that leads to a 
more general setting. In full generality, we will consider a set X and a family V = 
{Pi, Pi, ■ ■ ■ , Pm} of properties. We intend that for every x e X and each i = 1,2 , ... , m, 
either x satisfies P, or it does not. There is no ambiguity. Ultimately, we are interested 
in determining the number of elements of X which satisfy none of the properties in V . 
In Example 7.1, we could have made property Pi "is a computer science major" and 
property P2 "is male". Then the number of students satisfying neither P\ nor P2 would 
be the number of female students majoring in something other than computer science, 
exactly the number we were asked to determine. What would the properties Pi and P2 
be for Example 7.3? 

Let's consider three examples of larger sets of properties. These properties will come 
back up during the remainder of the chapter as we apply inclusion-exclusion to some 
more involved situations. Recall that throughout this book, we use the notation [n] for 
the set {1, 2 ,...,«} when n is a positive integer. 

Example 7.4. Let m and n be fixed positive integers and let X consist of all functions 
from [n] to [m |. Then for each i = 1,2, ... , m, and each function / e X, we say that 
/ satisfies P, if there is no j so that f(j) = i. In other words, i is not in the image or 
output of the function /. 

As a specific example, suppose that n = 5 and m =3. Then the function given by 
the table below satisfies Pi but not P2 or P3. 

i 1 2 3 4 5 

fit) 2 3 2 2 3 

Example 7.5. Let m be a fixed positive integer and let X consist of all bijections from 
[ m ] to \m\. Elements of X are called permutations. Then for each i = 1,2,..., m, and 
each permutation ueX, we say that 0 satisfies P, if o(i) = i. 

For example, the permutation a of [5] given in by the table below satisfies P3 and P5 
and no other P, . 


i 1 2 3 4 5 

o(i) 2 4 3 1 5~ 

Note that in the previous example, we could have said that a satisfies property P, if 
o(i) + i. But remembering that our goal is to count the number of elements satisfying 
none of the properties, we would then be counting the number of permutations sat- 
isfying ct(z’) = i for each i = 1,2, ... ,n, and perhaps we don't need a lot of theory to 
accomplish this task — the number is one, of course. 
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Example 7.6. Let m and n be fixed positive integers and let X = [n\. Then for each 
i = 1,2, .. . , m, and each j £ X, we say that j satisfies P, if i is a divisor of j. Put 
another way, the positive integers that satisfy property P, are precisely those that are 
multiples of i. 

At first this may appear to be the most complicated of the sets of properties we've 
discussed thus far. However, being concrete should help clear up any confusion. Sup- 
pose that n = m = 15. Which properties does 12 satisfy? The divisors of 12 are 1, 2, 3, 
4, 6, and 12, so 12 satisfies P i, Pj, P3, P4, P(,, and P 12. On the other end of the spectrum, 
notice that 7 satisfies only properties Pi and P7, since those are its only divisors. 

7.2 The Inclusion-Exclusion Formula 

Now that we have an understanding of what we mean by a property, let's see how we 
can use this concept to generalize the process we used in the first two examples of the 
previous section. 

Let X be a set and let P = {Pi, P2 , . . . , P m } be a family of properties. Then for each 
subset S c [m I, let N(S) denote the number of elements of X which satisfy property P, 
for all i £ S. Note that if S =0, then N(S) = |X|, as every element of X satisfies every 
property in S (which contains no actual properties). 

Returning for a moment to Example 7.1 with P 1 being "is a computer science major" 
and P2 being "is male," we note that N({1}) = 47, since there are 47 computer sci- 
ence majors in the class. Also, N({2}) = 51 since 51 of the students are male. Finally, 
N({1, 2}) = 45 since there are 45 male computer science majors in the class. 

In the examples of the previous section, we subtracted off N(S) for the sets S of size 
1 and then added back N(S ) for the set of properties of size 2, since we'd subtracted 
the number of things with both properties (male computer science majors or solutions 
with both X3 > 7 and x' 4 > 8) twice. Symbolically, we determined that the number of 
objects satisfying none of the properties was 

N(0)-N({1})-N({2}) + N({1,2}). 

Suppose that we had three properties Pi, P2, and P3. How would we count the num- 
ber of objects satisfying none of the properties? As before, we start by subtracting for 
each of Pi, P2, and P3. Now we have removed the objects satisfying both P 1 and P2 
twice, so we must add back N ({1 , 2}). similarly, we must do this for the objects satis- 
fying both P2 and P3 and both Pi and P3. Now let's think about the objects satisfying all 
three properties. They're counted in N(0), eliminated three times by the N ( { i } ) terms, 
and added back three times by the N({i,j}) terms. Thus, they're still being counted! 
Thus, we must yet subtract N({1, 2, 3}) to get the desired number: 

N(0) - N({ 1}) - N({2}) - N({ 3}) + N({1,2}) + N({2,3}) + N({1,3}) - N({1,2,3}). 
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We can generalize this as the following theorem: 

Theorem 7.7 (Principle of Inclusion-Exclusion). The number of elements ofX which satisfy 
none of the properties in P is given by 

E (-l) |s| N(S). (7.2.1) 

Sc[m] 

Proof. We proceed by induction on the number m of properties. If m = 1, then the 
formula reduces to N(0) - N({1}). This is correct since it says just that the number of 
elements which do not satisfy property P \ is the total number of elements minus the 
number which do satisfy property Pi. 

Now assume validity when m < k for some k > 1 and consider the case where 
m = k + 1. Let X' = {x £ X : x satisfies P^+i} and X" - X - X' (i.e., X" is the set of 
elements that do not satisfy Pjt+i). Also, let Q = {Pi,P 2 , ■ ■ ■ ,Pk}- Then for each subset 
S C [k |, let N'(S ) count the number of elements of X' satisfying property P, for all 
i £ S. Also, let N"(S ) count the number of elements of X" satisfying property P, for 
each i £ S. Note that N(S ) = N'(S ) + N"(S ) for every S c [k]. 

Let X' Q denote the set of elements in X' which satisfy none of the properties in Q (in 
other words, those that satisfy only P *+ 1 from P), and let X" denote the set of elements 
of X" which satisfy none of the properties in <3, and therefore none of the properties 
in P. 

Now by the inductive hypothesis, we know 

IXol = E (- 1 ) |S ' N '( s ) and l x 0 1 = E (-l) |Slw "(S). 

Sc[i] Sc[t| 

It follows that 

|X"| = E (-1) |S| N"(S) = E (-1) |S| (N(S)-N'(S)) 

Sc[J:] SC[k] 

= E (-1 ) |s| N(S) + E (-I) |s|+1 N(S U {k + 1}) 

Sc[*:] SQ[k] 

= E (-1) |S| N(S). 


7.3 Enumerating Surjections 

As our first example of the power of inclusion-exclusion, consider the following situ- 
ation: A grandfather has 15 distinct lottery tickets and wants to distribute them to his 


145 



Chapter 7 Inclusion-Exclusion 


four grandchildren so that each child gets at least one ticket. In how many ways can he 
make such a distribution? At first, this looks a lot like the problem of enumerating in- 
tegers solutions of equations, except here the lottery tickets are not identical! A ticket 
bearing the numbers 1, 3, 10, 23, 47, and 50 will almost surely not pay out the same 
amount as one with the numbers 2, 7, 10, 30, 31, and 48, so who gets which ticket re- 
ally makes a difference. Hopefully, you have already recognized that the fact that we're 
dealing with lottery tickets and grandchildren isn't so important here. Rather, the im- 
portant fact is that we want to distribute distinguishable objects to distinct entities, 
which calls for counting functions from one set (lottery tickets) to another (grandchil- 
dren). In our example, we don't simply want the total number of functions, but instead 
we want the number of surjections, so that we can ensure that every grandchild gets a 
ticket. 

For positive integers n and in, let S(n, m) denote the number of surjections from [n] 
to [m]. Note that S(n,m ) = 0 when n < m. In this section, we apply the Inclusion- 
Exclusion formula to determine a formula for S(n,m). We start by setting X to be the 
set of all functions from [n] to [m]. Then for each / e X and each i = 1,2, ... , m, we 
say that / satisfies property P, if i is not in the range of /. 

Lemma 7.8. For each subset S c [m\, N(S) depends only on |S|. In fact, if\S\ = k, then 


N(S ) = ( m-k ) n . 


Proof. Let |S| = k. Then a function / satisfying property P, for each z e S is a string of 
length n from an alphabet consisting of m — k letters. This shows that 


N(S) = ( m-k) n . 


□ 


Now the following result follows immediately from this lemma by applying the Prin- 
ciple of Inclusion-Exclusion, as there are C(m,k ) A: -element subsets of [m]. 

Theorem 7.9. The number S(n,m ) of surjections from [n] to [wz] is given by: 



m 


k = 0 


For example. 



243-96 + 3-0 
150. 
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Returning to our lottery ticket distribution problem at the start of the section, we 
see that there are S(15,4) = 1016542800 ways for the grandfather to distribute his 15 
lottery tickets so that each of the 4 grandchildren receives at least one ticket. 

7.4 Derangements 

Now let's consider a situation where we can make use of the properties defined in 
Example 7.5. Fix a positive integer n and let X denote the set of all permutations on 
[zz]. A permutation a £ X is called a derangement if cr(z) h i for all i = 1,2, . . . , n. For 
example, the permutation a given below is a derangement, while x is not. 

i 1 2 3 4 i 12 3 4 

a(i) 2 4 I 3~ t (z) 2 4~^3 T 

If we again let P, be the property that cr(z) = z, then the derangements are precisely 
those permutations which do not satisfy P, for any z = 1,2 , ,n. 

Lemma 7.10. For each subset S c [n], N(S) depends only on |S|. In fact, if\S\ = k, then 

N(S ) = (n - k)\ 

Proof. For each i £ S, the value o(i) = i is fixed. The other values of a are a permutation 
among the remaining n — k positions, and there are (n - k)\ of these. □ 

As before, the principal result of this section follows immediately from the lemma 
and the Principle of Inclusion-Exclusion. 

Theorem 7.11. For each positive integer n, the number d n of derangements of[n ] satisfies 

d n = ~ k)\. 

k=0 ' ' 

For example. 



= 120- 120 + 60-20 + 5-1 
= 44. 


It has been traditional to cast the subject of derangements as a story, called the Hat 
Check problem. The story belongs to the period of time when men wore top hats. For 
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a fancy ball, 100 men check their top hats with the Hat Check person before entering 
the ballroom floor. Later in the evening, the mischievous hat check person decides to 
return hats at random. What is the probability that all 100 men receive a hat other 
than their own? It turns out that the answer is very close to 1 /e, as the following result 
shows. 

Theorem 7.12. For a positive integer n, let d n denote the number of derangements of[n]. 
Then 

d n 1 
hm — - = -. 
n — >oo n\ e 

Equivalently, the fraction of all permutations of[n ] that are derangements approaches 1/e as n 
increases. 

Proof. It is easy to see that 


dn ru-^niXn-kf. 

n\ n\ 


= E(-« 


k = 0 


k n\ (n - k)\ 
k\(n - k)l n\ 




k = 0 


Recall from Calculus that the Taylor series expansion of e x is given by 


= V — 

~ ^ k!' 


k = 0 


and thus the result then follows by substituting x = — 1. 


Usually we're not as interested in d n itself as we are in enumerating permutations 
with certain restrictions, as the following example illustrates. 

Example 7.13. Consider the Hat Check problem, but suppose instead of wanting no 
man to leave with his own hat, we are interested in the number of ways to distribute 
the 100 hats so that precisely 40 of the men leave with their own hats. 

If 40 men leave with their own hats, then there are 60 men who do not receive their 
own hats. There are C(100, 60) ways to choose the 60 men who will not receive their 
own hats and dgo ways to distribute those hats so that no man receives his own. There's 
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only one way to distribute the 40 hats to the men who must receive their own hats, 
meaning that there are 

jrfgo =420788734922281721283274628333913452107738151595140722182899444 

67852500232068048628965153767728913178940196920 
such ways to return the hats. 

7.5 The Euler <ft Function 

After reading the two previous sections, you're probably wondering why we stated 
the Principle of Inclusion-Exclusion in such an abstract way, as in those examples N(S ) 
depended only on the size of S and not its contents. In this section, we produce an 
important example where the value of N(S) does depend on S. Nevertheless, we are 
able to make a reduction to obtain a useful end result. In what follows, let N denote 
the set of positive integers. 

For a positive integer n > 2, let 

( p(n ) = \{m e N : m < «,gcd(m,«) = 1}|. 

This function is usually called the Euler cp function or the Euler totient function and 
has many connections to number theory. We won't focus on the number-theoretic as- 
pects here, only being able to compute <p(n) efficiently for any n. 

For example, (p( 12) = 4 since the only numbers from {1,2,..., 12} that are relatively 
prime to 12 are 1, 5, 7 and 11. Asa second example, <p( 9) = 6 since 1, 2, 4, 5, 7 and 8 are 
relatively prime to 9. On the other hand, <p(p ) = p — 1 when p is a prime. Suppose you 
were asked to compute <'.5(321 974). How would you proceed? 

In Chapter 3 we discussed a recursive procedure for determining the greatest com- 
mon divisor of two integers, and we wrote code for accomplishing this task. Let's 
assume that we have a function gcd(m, n) that returns the greatest common divisor of 
the integers m and n. (Conveniently enough, SageMath comes such a function built in.) 
Then we can calculate (p{n ) with this code snippet: 



(100 
\ 60 
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1 47744 


Running the code above answers almost immediately that <£>(321974) = 147744. (As 
usual, in the web version of the text, you can change the value 321974 to calculate the 
value of (p for other integers. However, if you try to increase the value of n to be too 
large, you may run into memory issues imposed by the Sage Cell Server used by the 
text. For instance, attempting to calculate <£>(319572943) results in an error at the time 
of writing. (You may have better luck running the code directly in the SageMath Cloud 
or a local installation of SageMath.) 

Given these difficulties, how could we find 1 3691 22257328767073)? 

Clearly, the program is useless to tackle this beast! It not only iterates n—2 times but 
also invokes a recursion during each iteration. Fortunately, Inclusion-Exclusion comes 
to the rescue. 

Theorem 7.14. Let n > 2 be a positive integer and suppose that n has m distinct prime factors: 
Pi, P2,---,Pm- Then 



(7.5.1) 


!= 1 


Our proof of 7.14 requires the following elementary proposition whose proof we 
leave as an exercise. 

Proposition 7.15. Let n > 2, k > 1, and let p\,p 2 , ■ ■ ■ ,pk be distinct primes each of which 
divide n evenly (without remainder). Then the number of integers from {1,2, ... , n} which 
are divisible by each of these k primes is 


n 


PlP2---Pk 


Proof. We present the argument when m = 3. The full result is an easy extension. 
In light of 7.15, the Principle of Inclusion-Exclusion yields: 



PlPlPi - ( P2P3 + PlP3 + PlP2) + (P3 + P2 + Pi) ~ 1 


n 


P 1 P 2 P 3 


n 


pi - 1 p 2 - 1 P 3 ~ 1 
Pi P2 P3 


□ 
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Example 7.16. SageMath reports that 

1369122257328767073 = (3) 3 (11)(19) 4 (31) 2 (6067) 2 

is the factorization of 1369122257328767073 into primes. It follows that 

9 in 1 8 an ahaa 

(£(1369122257328767073) = 1369122257328767073 - — — — — . 

Thus SageMath quickly reports that 

(£(1369122257328767073) = 760615484618973600. 

Example 7.17. Amanda and Bruce receive the same challenge from their professor, 
namely to find (£(«) when 

n =31484972786199768889479107860964368171543984609017931 
39001922159851668531040708539722329324902813359241016 
93211209710523. 

However the Professor also tells Amanda that n = fppi is the product of two large 
primes where 

pi =470287785858076441566723507866751092927015824834881906763507 

and 

p 2 =669483106578092405936560831017556154622901950048903016651289. 

Is this information of any special value to Amanda? Does it really make her job any 
easier than Bruce's? Would it level the playing field if the professor told Bruce that n 
was the product of two primes? 

7.6 Discussion 

Yolanda said "This seemed like a very short chapter, at least it did to me." Bob agreed 
"Yes, but the professor indicated that the goal was just provide some key examples. I 
think he was hinting at more general notions of inversion — although I haven't a clue 
as to what they might be." 

Clearly aggravated, Zori said "I've had all I can stand of this big integer stuff. This 
won't help me to earn a living." Xing now was uncharacteristically firm in his reply 
"Zori. You're off base on this issue. Large integers, and specifically integers which 
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are the product of large primes, are central to public key cryptography. If you, or any 
other citizen, were highly skilled in large integer arithmetic and could quickly factor 
integers with, say 150 digits, then you would be able to unravel many important secrets. 
No doubt your life would be in danger." 

At first, the group thought that Xing was way out of bounds — but they quickly re- 
alized that Xing felt absolutely certain of what he was saying. Zori was quiet for the 
moment, just reflecting that maybe, just maybe, her skepticism over the relevance of 
the material in applied combinatorics was unjustified. 


7.7 Exercises 

1. A school has 147 third graders. The third grade teachers have planned a special 
treat for the last day of school and brought ice cream for their students. There are 
three flavors: mint chip, chocolate, and strawberry. Suppose that 60 students like (at 
least) mint chip, 103 like chocolate, 50 like strawberry, 30 like mint chip and strawberry, 
40 like mint chip and chocolate, 25 like chocolate and strawberry, and 18 like all three 
flavors. How many students don't like any of the flavors available? 

2 . There are 1189 students majoring in computer science at a particular university. 
They are surveyed about their knowledge of three programming languages: C++, Java, 
and Python. The survey results reflect that 856 students know C++, 748 know Java, and 
692 know Python. Additionally, 639 students know both C++ and Java, 519 know both 
C++ and Python, and 632 know both Java and Python. There are 488 students who 
report knowing all three languages. How many students reported that they did not 
know any of the three programming languages? 

3 . How many positive integers less than or equal to 100 are divisible by 2? How many 
positive integers less than or equal to 100 are divisible by 5? Use this information to 
determine how many positive integers less than or equal to 100 are divisible by neither 
2 nor 5. 

4 . How many positive integers less than or equal to 100 are divisible by none of 2, 3, 
and 5? 

5 . How many positive integers less than or equal to 1000 are divisible by none of 3, 8, 
and 25? 

6. The State of Georgia is distributing $173 million in funding to Fulton, Gwinnett, 
DeKalb, Cobb, and Clayton counties (in millions of dollars) . In how many ways can this 
distribution be made, assuming that each county receives at least $1 million, Clayton 
county receives at most $10 million, and Cobb county receives at most $30 million? 
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What if we add the restriction that Fulton county is to receive at least $5 million (instead 
of at least $1 million)? 

7. How many integer solutions are there to the equation x\ + Xi + X 3 + X 4 = 32 with 
0 < Xi < 10 for i = 1,2,3,47 

8. How many integer solutions are there to the inequality 

j/i + yi + 3/3 + 1/4 < 184 
with j/i > 0, 0 < 1/2 ^ 10, 0 < j/3 < 17, and 0 < 1/4 < 19? 

9. A graduate student eats lunch in the campus food court every Tuesday over the 
course of a 15-week semester. He is joined each week by some subset of a group of 
six friends from across campus. Over the course of a semester, he ate lunch with each 
friend 11 times, each pair 9 times, and each triple 6 times. He ate lunch with each 
group of four friends 4 times and each group of five friends 4 times. All seven of them 
ate lunch together only once that semester. Did the graduate student ever eat lunch 
alone? If so, how many times? 

10. A group of 268 students are surveyed about their ability to speak Mandarin, Ko- 
rean, and Japanese. There are 37 students who do not speak any of the three languages 
surveyed. Mandarin is spoken by 174 of the students, Japanese is spoken by 139 of 
the students, and Korean is spoken by 112 of the students. The survey results also 
reflect that 102 students speak both Mandarin and Japanese, 81 students speak both 
Mandarin and Korean, and 71 students speak both Japanese and Korean. How many 
students speak all three languages? 

11. As in Example 7.4, let X be the set of functions from [n] to [m | and let a function 
/ e X satisfy property P, if there is no j such that f(j) = i. 

(a) Let the function / : [ 8 ] — » [7] be defined by Table 7.18. Does / satisfy property 
P 2 ? Why or why not? What about property P 3 ? List all the properties P; (with 
i < 7) satisfied by /. 

(b) Is it possible to define a function g\ [ 8 ] — » [7] that satisfies no property P/, i < 7? 
If so, give an example. If not, explain why not. 

(c) Is it possible to define a function h : [ 8 ] — > [9] that satisfies no property Pi, i < 91 
If so, give an example. If not, explain why not. 

i 1 2 3 4 5 6 7 8 

f(i) 4 2 6 1 6 2 4 2 

Table 7.18: A function defined by a table 
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12. As in Example 7.5, let X be the set of permutations of [n] and say that a e X 
satisfies property P, if o(i) = i. 

(a) Let the permutation a : [8] — » [8] be defined by Table 7.19. Does a satisfy property 
P 2 ? Why or why not? What about property P 5 ? List all the properties P, (with 
i < 8) satisfied by a. 

(b) Give an example of a permutation t : [8] — » [8] that satisfies properties Pi, P 4 , and 
Pg and no other properties P, with 1 < i < 8. 

(c) Give an example of a permutation tc : [8] — » [8] that does not satisfy any property 
Pi with 1 < i < 8. 


i 1 2 3 4 5 6 7 8 

o(i) 3 1 8 4 7 — 6 5 2“ 

Table 7.19: A permutation defined by a table 


13. As in Example 7.6, let m and n be positive integers and X = [« |. Say that / e X 
satisfies property P, for an i with 1 < z < m if / is a divisor of /. 

(a) Let m = n = 15. Does 12 satisfy property P 3 ? Why or why not? What about 
property P 5 ? List the properties P, with 1 < i < 15 that 12 satisfies. 

(b) Give an example of an integer j with 1 <i< 15 that satisfies exactly two proper- 
ties P, with 1 < i < 15. 

(c) Give an example of an integer j with 1 < j < 15 that satisfies exactly four proper- 
ties P, with 1 < i < 15 or explain why such an integer does not exist. 

(d) Give an example of an integer j with 1 < / < 15 that satisfies exactly three prop- 
erties P, with 1 < i < 15 or explain why such an integer does not exist. 

14. How many surjections are there from an eight-element set to a six-element set? 

15. A teacher has 10 books (all different) that she wants to distribute to John, Paul, 
Ringo, and George, ensuring that each of them gets at least one book. In how many 
ways can she do this? 

16. A supervisor has nine tasks that must be completed and five employees to whom 
she may assign them. If she wishes to ensure that each employee is assigned at least 
one task to perform, how many ways are there to assign the tasks to the employees? 

17. A professor is working with six undergraduate research students. He has 12 topics 
that he would like these students to begin investigating. Since he has been working 
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with Katie for several terms, he wants to ensure that she is given the most challenging 
topic (and possibly others). Subject to this, in how many ways can he assign the topics 
to his students if each student must be assigned at least one topic? 

18 . List all the derangements of [4], (For brevity, you may write a permutation a as a 
string £t(1)ct(2)ct(3)(t(4).) 

19 . How many derangements of a nine-element set are there? 

20. A soccer team's equipment manager is in a hurry to distribute uniforms to the last 
six players to show up before a match. Instead of ensuring that each player receives his 
own uniform, he simply hands a uniform to each of the six players. In how many ways 
could he hand out the uniforms so that no player receives his own uniform? (Assume 
that the six remaining uniforms belong to the last six players to arrive.) 

21 . A careless payroll clerk is placing employees' paychecks into envelopes that have 
been pre-labeled. The envelopes are sealed before the clerk realizes he didn't match 
the names on the paychecks with the names on the envelopes. If there are seven em- 
ployees, in how many ways could he have placed the paychecks into the envelopes so 
that exactly three employees receive the correct paycheck? 

22 . The principle of inclusion-exclusion is not the only approach available for counting 
derangements. We know that d i = 0 and dj = 1. Using this initial information, it is 
possible to give a recursive form for d n . In this exercise, we consider two recursions 
for d n . 

(a) Give a combinatorial argument to prove that the number of derangements satis- 
fies the recursive formula d n = (n - 1 )(d n -i + d n - 2 ) for n > 2. 

(b) Prove that the number of derangements also satisfies the recursive formula d n = 
nd n - 1 + (-1)' 1 for n > 2. 

Hint. 

(a) For a derangement a, consider the integer k with a(k ) = 1. Argue based on the 
number of choices for k and then whether <j(l) = k or not. 

(b) You may find it easiest to prove this using the other recursive formula and math- 
ematical induction. 

23. Determine yy (18) by listing the integers it counts as well as by using the formula 
of Theorem 7.14. 

24 . Compute (£(756). 

25 . Given that 1625190883965792 = (2) 5 (3) 4 (11) 2 (13)(23) 3 (181) 2 , compute 

(£(1625190883965792). 
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26. Prove Proposition 7.15. 

27. At a very small school, there is a class with nine students in it. The students, whom 
we will denote as A, B, C, D, E, F, G, H, and I, walk from their classroom to the 
lunchroom in the order ABCDEFGHI. (Let's say that A is at the front of the line.) On 
the way back to their classroom after lunch, they would like to walk in an order so 
that no student walks immediately behind the same classmate he or she was behind 
on the way to lunch. (For instance, ACBDIHGFE and IHGFEDCBA would meet their 
criteria. However, they would not be happy with CEFGBADH1 since it contains FG 
and HI, so G is following F again and I is following H again.) 

(a) One student ponders how many possible ways there would be for them to line 
up meeting this criterion. Help him out by determining the exact value of this 
number. 

(b) Is this number bigger than, smaller than, or equal to the number of ways they 
could return so that no student walks in the same position as before (i.e., A is not 
first, B is not second, . . ., and I is not last)? 

(c) What fraction (give it as a decimal) of the total number of ways they could line up 
meet their criterion of no student following immediately behind the same student 
on the return trip? 
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Generating Functions 

A standard topic of study in first-year calculus is the representation of functions as in- 
finite sums called power series; such a representation has the form F(x ) = a n x n . 
Perhaps surprisingly these power series can also serve as very powerful enumerative 
tools. In a combinatorial setting, we consider such power series of this type as another 
way of encoding the values of a sequence {a n : n > 0} indexed by the non-negative 
integers. The strength of power series as an enumerative technique is that they can 
be manipulated just like ordinary functions, i.e., they can be added, subtracted and 
multiplied, and for our purposes, we generally will not care if the power series con- 
verges, which anyone who might have found all of the convergence tests studied in 
calculus daunting will likely find reassuring. However, when we find it convenient to 
do so, we will use the familiar techniques from calculus and differentiate or integrate 
them term by term, and for those familiar series that do converge, we will use their 
representations as functions to facilitate manipulation of the series. 


8.1 Basic Notation and Terminology 

With a sequence a = {a n : n > 0} of real numbers, we associate a "function" F(x) 
defined by 

oo 

F(x) = J^a n x n . 

n = 0 

The word "function" is put in quotes as we do not necessarily care about substituting 
a value of x and obtaining a specific value for F(x). In other words, we consider F(x) 
as a formal power series and frequently ignore issues of convergence. 

It is customary to refer to F(x) as the generating function of the sequence a. As we 
have already remarked, we are not necessarily interested in calculating F(x) for specific 
values of x. However, by convention, we take F(0) = iiq. 
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Example 8.1. Consider the constant sequence a = {a n : n > 0} with a n = 1 for every 
n > 0. Then the generating function F(x) of o is given by 

F(x) = 1 + x + x 2 + x 3 + x 4 + x 5 + x 6 H . 


You probably remember that this last expression is the Maclaurin series for the func- 
tion F(x) = 1/(1 —x) and that the series converges when \x \ < 1. Since we want to think 
in terms of formal power series, let's see that we can justify the expression 

1 °° 

= 1 + X + X 2 + X 3 + x 4 + X 5 + X 6 + ■ ■ ■ = V* x n 

1 -X 

12=0 

without any calculus techniques. Consider the product 

(1 - x)(l + X + x 2 + x 3 + x 4 + X 5 + x 6 + • • • ) 


and notice that, since we multiply formal power series just like we multiply polyno- 
mials (power series are pretty much polynomials that go on forever), we have that this 
product is 

(1 + X + x 2 + x 3 + x 4 + X 5 + x 6 + • • • ) - x(l + X + x 2 + X 3 + x 4 + X 5 + X 6 H ) = 1. 

Now we have that 


(1 - x)(l + X + x 2 + X 3 + x 4 + X 5 + x 6 + • • • ) = 1, 


or, more usefully, after dividing through by 1 - x. 


1 

1 - x 


OO 


2 >"- 

22=0 


Example 8.2. Just like you learned in calculus for Maclaurin series, formal power series 
can be differentiated and integrated term by term. The rigorous mathematical frame- 
work that underlies such operations is not our focus here, so take us at our word that 
this can be done for formal power series without concern about issues of convergence. 

To see this in action, consider differentiating the power series of the previous exam- 
ple. This gives 


= 1 + 2x + 3x 2 + 4x 3 + 5x 4 + 6x 5 + 7x 6 h 

(1 - x) 2 


Z 

22=1 


nx 


22-1 


Integration of the series represented by 1/(1 + x) = 1/(1 - ( — x)) yields (after a bit of 
algebraic manipulation) 


log(l +*) = *- y + y- 





22=1 
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Before you become convinced that we're only going to concern ourselves with gener- 
ating functions that actually converge, let's see that we can talk about the formal power 
series 

oo 

F(x ) = ^ nix", 

n=0 

even though it has radius of convergence 0, i.e., the series F(x) converges only for x = 0, 
so that F(0) = 1. Nevertheless, it makes sense to speak of the formal power series F(x) 
as the generating function for the sequence {a n : n > 0}, Uq = 1 and a n is the number 
of permutations of {1, 2 when n > 1. 

For reference, we state the following elementary result, which emphasizes the form 
of a product of two power series. 

Proposition 8.3. Let A(x) = Q a n x n and B(x) = be generating functions. 

Then A(x)B(x) is the generating function of the sequence zvhose n th term is given by 

n 

aob n + a\b n -\ + a 2 b n -2 + ■ ■ ■ + a n bo = ^ a^b n - 

k = o 

8.2 Another look at distributing apples or folders 

A recurring problem so far in this book has been to consider problems that ask about 
distributing indistinguishable objects (say apples) to distinct entities (say children). 
We started in Chapter 2 by asking how many ways there were to distribute 40 apples 
to 5 children so that each child is guaranteed to get at least one apple and saw that 
the answer was C(39,4). We even saw how to restrict the situation so that one of the 
children was limited and could receive at most 10 apples. In Chapter 7, we learned how 
to extend the restrictions so that more than one child had restrictions on the number 
of apples allowed by taking advantage of the Principle of Inclusion-Exclusion. Before 
moving on to see how generating functions can allow us to get even more creative with 
our restrictions, let's take a moment to see how generating functions would allow us 
to solve the most basic problem at hand. 

Example 8.4. We already know that the number of ways to distribute n apples to 5 
children so that each child gets at least one apple is C(n - 1 , 4), but it will be instructive 
to see how we can derive this result using generating functions. Let's start with an even 
simpler problem: how many ways are there to distribute n apples to one child so that 
each child receives at least one apple? Well, this isn't too hard, there's only one way 
to do it — give all the apples to the lucky kid! Thus the sequence that enumerates the 
number of ways to do this is {a n : n > 1} with a n = 1 for all n > 1. Then the generating 
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function for this sequence is 


X + x 2 + x 3 -\ = x(l + x + x 2 + x 3 + ■ • ■ ) = — - — . 

v 1 -x 

How can we get from this fact to the question of five children? Notice what happens 
when we multiply 

(x + x 2 + ■ • ■ )(x + x 2 + ■ ■ ■ )(x + x 2 H )(x + x 2 + ■ ■ ■ )(x + x 2 + • • • ). 


To see what this product represents, first consider how many ways can we get an 
x 6 ? We could use the x 2 from the first factor and x from each of the other four, or 
x 2 from the second factor and x from each of the other four, etc., meaning that the 
coefficient on x 6 is 5 = C( 5,4). More generally, what's the coefficient on x" in the 
product? In the expansion, we get an x n for every product of the form x k] x kl x ki x k * x kb 
where k\ + A: 2 + A3 + Aq + k$ = n. Returning to the general question here, we're really 
dealing with distributing n apples to 5 children, and since A; > 0 for i = 1, 2, . . . , 5, we 
also have the guarantee that each child receives at least one apple, so the product of 
the generating function for one child gives the generating function for five children. 

Let's pretend for a minute that we didn't know that the coefficients must be C(n - 
1,4). How could we figure out the coefficients just from the generating function? The 
generating function we're interested in is x 5 /(l -x) 5 , which you should be able to pretty 
quickly see satisfies 


(1 - x) 5 


The coefficient on x n in this series C(n — 1,4), just as we expected. 

We could revisit an example from Chapter 7 to see that if we wanted to limit a child 
to receive at most 4 apples, we would use (x + x 2 + x 3 + x 4 ) as its generating function 
instead of x/( 1 - x), but rather than belabor that here, let's try something a bit more 
exotic. 

Example 8.5. A grocery store is preparing holiday fruit baskets for sale. Each fruit bas- 
ket will have 20 pieces of fruit in it, chosen from apples, pears, oranges, and grapefruit. 
How many different ways can such a basket be prepared if there must be at least one 
apple in a basket, a basket cannot contain more than three pears, and the number of 
oranges must be a multiple of four? 


X 5 d 4 ( 1 \ X 5 y-i 

= ¥ Sii ( w) = 4! 2 »(» - ')<» - 2 ><" - 3 >* 

n= 0 

= n ( n - !)(» ~ 2 x» ~ 3 ) x »+i = jr l n \ x ' i+i 
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Solution. In order to get at the number of baskets consisting of 20 pieces of fruit, let's 
solve the more general problem where each basket has n pieces of fruit. Our method is 
simple: find the generating function for how to do this with each type of fruit individ- 
ually and then multiply them. As in the previous example, the product will contain 
the term x n for every way of assembling a basket of n pieces of fruit subject to our 
restrictions. The apple generating function is x/(l - x), since we only want positive 
powers of x (corresponding to ensuring at least one apple). The generating function 
for pears is (1 + x + x 2 + x 3 ), since we can have only zero, one, two, or three pears in 

basket. For oranges we have 1/(1- x 4 ) = l+x 4 +x 8 H , and the unrestricted grapefruit 

give us a factor of 1/(1 - x). Multiplying, we have 


1 - x 


(1 + X + x 2 + X 3 ) 


1 


1 


1 - x 4 1 - X (1 - x) 2 (l - X 4 ) 


(1 + X + X 2 + X 3 ). 


Now we want to make use of the fact that (1 + x + x 2 + x 3 ) = (1 - x 4 )/(l - x) to see that 
our generating function is 


x 

(1 - x) 3 


I Yj n ( n ~ r > x 

n = 0 


oo 


X 

n=0 


n(»~ l^ n-t 




Thus, there are C(n +1,2) possible fruit baskets containing n pieces of fruit, meaning 
that the answer to the question we originally asked is C(21, 2) = 210. 

Example 8.6. Find the number of integer solutions to the equation 


xi + X2 + X3 = n 

(n > 0 an integer) with X\ > 0 even, X2 > 0, and 0 < X3 < 2. 

Solution. Again, we want to look at the generating function we would have if each 
variable existed individually and take their product. For Xi, we get a factor of 1 /(I -x 2 ); 
for X2, we have 1 /(I - x); and for X3 our factor is (1 + x + x 2 ). Therefore, the generating 
function for the number of solutions to the equation above is 

1+x + x 2 1 + x + x 2 

(1 - x)(l - X 2 ) (1 + x)(l - x) 2 

In calculus, when we wanted to integrate a rational function of this form, we would 
use the method of partial fractions to write it as a sum of "simpler" rational functions 
whose antiderivatives we recognized. Flere, our technique is the same, as we can read- 
ily recognize the formal power series for many rational functions. Our goal is to write 

1+x+x 2 A B C 

(1 + x)(l - x) 2 1 + x + 1 - x + (1 - x) 2 
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for appropriate constants. A, B, and C. To find the constants, we clear the denomina- 
tors, giving 

1 + x + x 2 = A( 1 - x) 2 + B(1 - x 2 ) + C(1 + x). 

Equating coefficients on terms of equal degree, we have: 

1 =A+B+C 
1 = -2 A + C 
1 =A-B 


Solving the system, we find A = 1/4, B = -3/4, and C = 3/2. Therefore, our generating 
function is 


1 1 


3 1 3 

+ -- 


41 +x 41 -x 2 (1 - x) 2 4 


°o oo 


The solution to our question is thus the coefficient on x n in 
function, which is 

(-1 ) n 3 3 (n + 1) 

4 4 + 2 



n = 0 

the above generating 


a surprising answer that would not be too easy to come up with via other methods! 


8.3 Newton’s Binomial Theorem 

In Chapter 2, we discussed the binomial theorem and saw that the following formula 
holds for all integers p > 1 : 

a 

n = 0 ' ' 

You should quickly realize that this formula implies that the generating function for 
the number of ft -element subsets of a p -element set is (1 + x) p . The topic of generat- 
ing functions is what leads us to consider what happens if we encounter (1 + x) 1 ’ as a 
generating function with p not a positive integer. It turns out that, by suitably extend- 
ing the definition of the binomial coefficients to real numbers, we can also extend the 
binomial theorem in a manner originally discovered by Sir Isaac Newton. 

We've seen several expressions that can be used to calculate the binomial coefficients, 
but in order to extend C(p,k) to real values of p, we will utilize the form 

(p\ __ P{p,k ) 

U k\ ' 
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recalling that we've defined P(p,k ) recursively as Pip , 0) = 1 for all integers p > 0 and 
P(p, k) = pP(p — l,k — l) when p > k > 0 (k an integer). Notice here, however, that the 
expression for P(p ,k) makes sense for any real number p, so long as A: is a non-negative 
integer. We make this definition formal. 

Definition 8.7. For all real numbers p and nonnegative integers k, the number Pip , k) 
is defined by 

1. P(p, 0) = 1 for all real numbers p and 

2. P(p, k) = pP(p — 1, k — 1) for all real numbers p and integers k > 0. 

(Notice that this definition does not require p > k as we did with integers.) 

We are now prepared to extend the definition of binomial coefficient so that C(p,k) 
is defined for all real p and nonnegative integer values of k. We do this as follows. 

Definition 8.8. For all real numbers p and nonnegative integers k, 

(p\ = P(p,k) 

W *! ‘ 


Note that P(p,k ) = C(p,k) = 0 when p and k are integers with 0 < p < k. On the 
other hand, we have interesting new concepts such as P(— 5, 4) = (-5)(-6)(-7)(-8) and 

1-7/ 2\ = (— 7/2)( — 9/2)(— ll/2)(— 13/2)(— 15/2) 

\ 5 J 5! 

With this more general definition of binomial coefficients in hand, we're ready to 
state Newton's Binomial Theorem for all non-zero real numbers. The proof of this 
theorem can be found in most advanced calculus books. 

Theorem 8.9 (Newton's Binomial Theorem). For all real p with p + 0, 

n=0 ' * 

Note that the general form reduces to the original version of the binomial theorem 
when p is a positive integer. 
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8.4 An Application of the Binomial Theorem 

In this section, we see how Newton's Binomial Theorem can be used to derive another 
useful identity. We begin by establishing a different recursive formula for P(p,k) than 
was used in our definition of it. 

Lemma 8.10. For each k > 0, P(p, k + 1) = P(p, k)(p - k). 

Proof. When k - 0, both sides evaluate to p. Now assume validity when k = m for 
some non-negative integer m . Then 

P(p, m + 2) = pP{p — l,m + 1) 

= p[P(p - 1, m)(p - 1 - m )] 

= [pP(p - 1, m)](p - 1 — m) 

= P(p, m + 1 )[p - (m + 1)]. 


□ 


Our goal in this section will be to invoke Newton's Binomial Theorem with the ex- 
ponent p = -1/2. To do so in a meaningful manner, we need a simplified expression 
for C(-l/2, k), which the next lemma provides. 

Lemma 8.11. For each k > 0, 

Proof. We proceed by induction on k. Both sides reduce to 1 when k = 0. Now assume 
validity when k = m for some non-negative integer m . Then 


( 2k ) 

= (-l) k - —. 
y ’ 2 lk 


-1/2 \ _ P(— 1/2, m + 1) _ P(-l/2, m)(-l/2 - m) 
m + l) (m + l)\ ( m + l)m! 

= -l/2-m (-l/2\ = 2m +1 Q 
m+l \ m J 2{m + 1) 2 lm 

= „, +1 1 (2m+2)(2m + l) /2m\ = m+1 Cn"+ '£ 

{ ; 2 2m (2m + 2)2 (m + 1 )\m ) K 2 2m+2 ' 


Theorem 8.12. The function f(x) = (1 - 4x) 1 is the generating function of the sequence 

iO --n> 0}. 
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Proof. By Newton's Binomial Theorem and Lemma 8.11, we know that 


(1 - 4x) _1/2 



(-4x) H 


oo 



£(-l)"2 2 " 


X 


n 


n= 0 



n 


□ 


Now recalling Proposition 8.3 about the coefficients in the product of two generating 
functions, we are able to deduce the following corollary of Theorem 8.12 by squaring 
the function f(x) = (1 - 4x) _1,,2 . 

Corollary 8.13. For all n > 0, 



8.5 Partitions of an Integer 

A recurring theme in this course has been to count the number of integer solutions 
to an equation of the form x\ + X 2 + ■ ■ ■ + x/t = n . What if we wanted to count the 
number of such solutions but didn't care what k was? How about if we took this new 
question and required that the x, be distinct (i.e., x, + X ; for i + /)? What about if we 
required that each x, be odd? These certainly don't seem like easy questions to answer 
at first, but generating functions will allow us to say something very interesting about 
the answers to the last two questions. 

By a partition P of an integer, we mean a collection of (not necessarily distinct) pos- 
itive integers such that XreP z = n - (By convention, we will write the elements of P 
from largest to smallest.) For example, 2 + 2 + 1 is a partition of 5. For each n > 0, let 
p n denote the number of partitions of the integer n (with p o = 1 by convention). Note 
that ps = 22 as evidenced by the list in Table 8.14. 


165 


Chapter 8 Generating Functions 


8 distinct parts 
6 + 1+1 

5+1+1+1 odd parts 

4+2+2 

3+3+2 

3+2+1+1+1 

2 + 2 + 2 + 1+1 


7+1 distinct parts, odd parts 
5+3 distinct parts, odd parts 
4+4 

4+2+1+1 

3+3+1+1 odd parts 
3+1+1+1+1+1 odd parts 
2 + 2 + 1 + 1 + 1+1 

l+l+l+l+l+l+l+l odd parts 


6+2 distinct parts 

5+2+1 distinct parts 

4+3+1 distinct parts 

4+1+1+1+1 

3+2+2+1 

2 + 2 + 2+2 

2 + 1 + 1 + 1 + 1 + 1+1 


Table 8.14: The partitions of 8, noting those into distinct parts and those into odd 

PARTS. 


Note that there are 6 partitions of 8 into distinct parts. Also there are 6 partitions of 
8 into odd parts. While it might seem that this is a coincidence, it in fact is always the 
case as Theorem 8.15 states. Before looking at that theorem and its proof, let's think 
about what a generating function for p n , the number of partitions of n, would look like. 
Given a partition of n, we can count how many l's appear, how many 2's appear, and 
so on. This suggests a similarity with our fruit basket problems earlier in the chapter, 
leading to the generating function 


P(x) = 







1 

l-x m ' 


Here the factor whose sum contains terms x km is accounting for the number of k’s in 
the partition. While P(x ) has a quite elegant form, that doesn't mean that it's terri- 
bly useful for computing p n . In fact, providing an asymptotic estimate for p n was a 
notoriously difficult problem, finally addressed by Hardy and Ramanujan in 1918. A 
popular account of this can be found in Robert Kanigel's 1991 book The Man who Knew 
Infinity or the 2016 film with the same title. 

Proving the relationship between the number of partitions into distinct parts and the 
number of partitions into odd parts will involve restricted versions of the generating 
function P(x ) from above. 

Theorem 8.15. For each n > 1, the number of partitions ofn into distinct parts is equal to the 
number of partitions ofn into odd parts. 

Proof. The generating function D(x) for the number of partitions of n into distinct parts 
is 

oo 

D(x) = J J(1 + x n ). 

n= 1 
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On the other hand, the generating function 0(x ) for the number of partitions of n into 
odd parts is 



ToseethatD(x) = O(x), we note that 1-x 2 " = (l-x")(l+x")foralln > 1. Therefore, 




= O(x). 


□ 


8.6 Exponential generating functions 

If we had wanted to be absolutely precise earlier in the chapter, we would have referred 
to the generating functions we studied as ordinary generating functions or even or- 
dinary power series generating functions. This is because there are other types of 
generating functions, based on other types of power series. In this section, we briefly 
introduce another type of generating function, the exponential generating function. 
While an ordinary generating function has the form an exponential gener- 

ating function is based on the power series for the exponential function e x . Thus, the 
exponential generating function for the sequence {a n : n > 0} is a n x n /n\. In this 
section, we will see some ways we can use exponential generating functions to solve 
problems that we could not tackle with ordinary generating functions. However, we 
will only scratch the surface of the potential of this type of generating function. We be- 
gin with the most fundamental exponential generating function, in analogy with the 
ordinary generating function 1/(1 - x) of Example 8.1. 

Example 8.16. Consider the constant sequence 1, 1, 1, 1, . . .. Then the exponential gen- 
erating function for this sequence is 



n= 0 


From calculus, you probably recall that this is the power series for the exponential 
function e x , which is why we call this type of generating function an exponential gen- 
erating function. From this example, we can quickly recognize that the exponential 
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generating function for the number of binary strings of length n is e lx since 


e 


2x 


oo 


Z 

n = 0 


(2x) n 

n\ 


Z 2 " 

n = 0 


X n 

n\ ' 


In our study of ordinary generating functions earlier in this chapter, we considered 
examples where quantity (number of apples, etc.) mattered but order did not. One of 
the areas where exponential generating functions are preferable to ordinary generating 
functions is in applications where order matters, such as counting strings. For instance, 
although the bit strings 10001 and 011000 both contain three zeros and two ones, they 
are not the same strings. On the other hand, two fruit baskets containing two apples 
and three oranges would be considered equivalent, regardless of how you arranged 
the fruit. We now consider a couple of examples to illustrate this technique. 

Example 8.17. Suppose we wish to find the number of ternary strings in which the 
number of 0s is even. (There are no restrictions on the number of Is and 2s.) As with 
ordinary generating functions, we determine a generating function for each of the dig- 
its and multiply them. For Is and 2s, since we may have any number of each of them, 
we introduce a factor of e x for each. For an even number of 0s, we need 


1 


y2 y6 

A .A- A 

+ 2!~ + 4!" + 61 + ' 


OO 


Z 

n = 0 


x 2n 
(2 n )\ ' 


Unlike with ordinary generating functions, we cannot represent this series in a more 
compact form by simply substituting a function of x into the series for e l/ . Flowever, 
with a small amount of cleverness, we are able to achieve the desired result. To do this, 
first notice that 


= 1 


2 3 

x° 

x + Y\~ 3\ + ‘ 


z 


12=0 


(■ -l) n x n 
n\ 


Thus, when we add the series for e x to the series for e x all of the terms with odd 
powers of x will cancel! We thus find 


v 2 r 4 

■T* =2 + 2— +2— + ' 


2 ! 


4! 


which is exactly twice what we need. Therefore, the factor we introduce for 0s is (e x + 
e~ x )/2. 

Now we have an exponential generating function of 
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To find the number of ternary strings in which the number of Os is even, we thus need 
to look at the coefficient on x n /n\ in the series expansion. In doing this, we find that 
the number of ternary strings with an even number of Os is (3” + l)/2. 

We can also use exponential generating functions when there are bounds on the 
number of times a symbol appears, such as in the following example. 

Example 8.18. How many ternary strings of length n have at least one 0 and at least 
one 1? 

Solution. To ensure that a symbol appears at least once, we need the following ex- 
ponential generating function 


2 3 

X° 

X+ 22 + 3\ + ' 



n = 1 


You should notice that this is almost the series for e x , except it's missing the first term. 
Thus, x n /n\ = e x - 1. Using this, we now have 

(e x - l)(e x - l)e x = e 3x - 2e 2x + e* 


as the exponential generating function for this problem. Finding the series expansion, 
we have 


OO 


£ 

n = 0 


3 n x n 

n\ 




n = 0 


2 n x n 

n\ 


+ 



n= 0 


Now we can answer the question by reading off the coefficient on x n / n !, which is 3" - 
2 • 2 " + 1 . 


Before proceeding to an additional example, let's take a minute to look at another 
way to answer the question from the previous example. To count the number of ternary 
strings of length n with at least one 0 and at least one 1, we can count all ternary strings 
of length n and use the principle of inclusion-exclusion to eliminate the undesirable 
strings lacking a 0 and / or a 1 . If a ternary string lacks a 0, we're counting all strings 
made up of Is and 2s, so there are 2" strings. Similarly for lacking a 1. However, if 
we subtract 2 -2”, then we've subtracted the strings that lack both a 0 and a 1 twice. 
A ternary string that has no Os and no Is consists only of 2s. There is a single ternary 
string of length n satisfying this criterion. Thus, we obtain 3" - 2 • 2" + 1 in another 
way. 

Example 8.19. Alice needs to set an eight-digit passcode for her mobile phone. The 
restrictions on the passcode are a little peculiar. Specifically, it must contain an even 
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number of Os, at least one 1, and at most three 2s. Bob remarks that although the re- 
strictions are unusual, they don't do much to reduce the number of possible passcodes 
from the total number of 10 8 eight-digit strings. Carlos isn't convinced that's the case, 
so he works up an exponential generating function as follows. For the seven digits on 
which there are no restrictions, a factor of e 7x is introduced. To account for an even 
number of Os, he uses ( e x + e~ x )l 2. For at least one 1, a factor of e x - 1 is required. Fi- 
nally, 1 +x'+x 2 /2!+x 3 /3! accounts for the restriction of at most three 2s. The exponential 
generating function for the number of n -digit passcodes is thus 



Dave sees this mess written on the whiteboard and groans. Fie figures they'll be 
there all day multiplying and making algebra mistakes in trying to find the desired 
coefficient. Alice points out that they don't really need to find the coefficient on x n /n\ 
for all n. Instead, she suggests they use a computer algebra system to just find the coef- 
ficient on x®/8!. After doing this, they find that there are 33847837 valid passcodes for 
the mobile phone. A quick calculation shows that Bob was totally off base in claiming 
that there was no significant reduction in the number of possible strings to use as a 
passcode. The total number of valid passcodes is only 33.85% of the total number of 
eight-digit strings! 

Exponential generating functions are useful in many other situations beyond enu- 
merating strings. For instance, they can be used to count the number of n -vertex, con- 
nected, labeled graphs. However, doing so is beyond the scope of this book. If you 
are interested in learning much more about generating functions, the book generating- 
functionology by Herbert S. Wilt is available online at http://www.math.upenn.edu/~witf/ 
DownldGF . html. 

8.7 Discussion 

After studying the proof that the number of partitions of an integer into odd parts is the 
same as the number of partitions of that integer into distinct parts, Yolanda was beside 
herself. "Do you guys realize what we just did? We showed that two quantities were 
equal without saying anything about what those quantities actually were. That's really 
neat," she said. Nobody said anything for a long time, but after some time Dave said 
"There might be other instances where you would want to be able to communicate 
fully, yet hold back on every last detail." Bob said "I don't get it." Alice interjected 
a comment that was more of question than a statement "Do you mean that parties 
may want to communicate, while maintaining that the conversation did not occur?" 
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Carlos added "Or maybe they just want to be able to detect whether anyone else was 
listening." Now Zori was nearly happy. Privacy and security were big ticket items. 


8.8 Exercises 

Computer algebra systems can be powerful tools for working with generating func- 
tions. In addition to stand-alone applications that run on your computer, the website 
WolframAlpha is capable of finding general forms of some power series representa- 
tions and specific coefficients for many more. However, unless an exercise specifically 
suggests that you use a computer algebra system, we strongly encourage you to solve 
the problem by hand. This will help you develop a better understanding of how gen- 
erating functions can be used. 

For all exercises in this section, "generating function" should be taken to mean "or- 
dinary generating function." Exponential generating functions are only required in 
exercises specifically mentioning them. 

1. For each finite sequence below, give its generating function. 

(a) 1,4,6, 4,1 (d) 1,1, 1,1, 1,1,1 

(b) 1,1, 1,1, 1,0, 0,1 (e) 3, 0,0, 1,-4, 7 

(c) 0,0, 0,1, 2, 3, 4, 5 (f) 0,0, 0,0, 1,2, -3, 0,1 


2. For each infinite sequence suggested below, give its generating function in closed 

form, i.e., not as an infinite sum. (Use the most obvious choice of form for the general 

term of each sequence.) 


(a) 0, 1, 1, 1, 1, 1, . . . 

(b) 1,0,0,1,0,0,1,0,0,1,0,0,1,... 

(c) 1,2,4,8,16,32,... 

(d) 0 , 0 , 0 , 0 , 1 , 1 , 1 , 1 , 1 , 1 , 1 , 1 , 1 , 1 , 1 ,... 

(e) 1,-1, 1,-1, 1,-1, 1,-1, 1,-1,... 

m 2 * * »,2-(f),2-(«) (g)'0. 0, 0. 


(g) 1, 1, 1, 0, 0, 1, 1, 1, 1, 1, 1, 1,1,1,... 

(h) 0,0,0, 1,2, 3, 4, 5, 6, . . . 

(i) 3,2,4, 1, 1, 1, 1,1,1,... 

(j) 0, 2, 0, 0, 2, 0, 0, 2, 0, 0, 2, 0, 0, 2, . . . 

(k) 6, 0, — 6, 0, 6, 0, — 6, 0, 6, . . . 

(l) 1,3,6, 10, 15,..., (” ^ 2 ),--- 


3. For each generating function below, give a closed form for the n th term of its asso- 
ciated sequence. 

(a) (1 + x) 10 
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(b) 

(c) 

(d) 

(e) 

(f) 

(g) 

(h) 

(i) 

(j) 


1 

1 - x 4 


1 - x 4 
1-x 4 
1-X 

1 + X 2 - X 4 

1-x 

1 

1 - 4x 
1 

1 + 4x 


(1 - x) 4 
X 2 + X + 1 

1-x 7 

3x 4 + 7x 3 - x 2 + 10 H — — 

1-x 3 


4 . Find the coefficient on x 10 in each of the generating functions below. 

(a) (x 3 + x 5 + x 6 )(x 4 + x 5 + x 7 )(l + x 5 + x 10 + x 15 + • • • ) 

(b) (1 + x 3 )(x 3 + x 4 + x 5 + • • • )(x 4 + x 5 + x 6 + x 7 + x 8 + • • • ) 


(c) (1+x) 12 

X 5 

(d) T^ 

(e) 1 

(f) 

(g) 

(h) 


(1 - x) 3 
1 

1 - 5x 4 
x 

1 -2x 3 
1-x 14 
1-x 


5 . Find the generating function for the number of ways to create a bunch of n balloons 
selected from white, gold, and blue balloons so that the bunch contains at least one 
white balloon, at least one gold balloon, and at most two blue balloons. Flow many 
ways are there to create a bunch of 10 balloons subject to these requirements? 
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6 . A volunteer coordinator has 30 identical chocolate chip cookies to distribute to six 
volunteers. Use a generating function (and computer algebra system) to determine the 
number of ways she can distribute the cookies so that each volunteer receives at least 
two cookies and no more than seven cookies. 

7 . Consider the inequality 

X\ + X 2 + *3 + x\ < n 

where x\, X 2 , x'3, J4, n > 0 are all integers. Suppose also that x .2 > 2, xj is a multiple of 
4, and 0 < X 4 < 3. Let c„ be the number of solutions of the inequality subject to these 
restrictions. Find the generating function for the sequence { c n : n >0} and use it to 
find a closed formula for c n . 

8. Find the generating function for the number of ways to distribute blank scratch 
paper to Alice, Bob, Carlos, and Dave so that Alice gets at least two sheets. Bob gets at 
most three sheets, the number of sheets Carlos receives is a multiple of three, and Dave 
gets at least one sheet but no more than six sheets of scratch paper. Without finding 
the power series expansion for this generating function (or using a computer algebra 
system!), determine the coefficients on x 2 and x 3 in this generating function. 

9 . What is the generating function for the number of ways to select a group of n stu- 
dents from a class of p students? 

10 . Using generating functions, find a formula for the number of different types of 
fruit baskets containing of n pieces of fruit chosen from pomegranates, bananas, ap- 
ples, oranges, pears, and figs that can be made subject to the following restrictions: 

• there are either 0 or 2 pomegranates, 

• there is at least 1 banana, 

• the number of figs is a multiple of 5, 

• there are at most 4 pears, and 

• there are no restrictions on the number of apples or oranges. 

Flow many ways are there to form such a fruit basket with n = 25 pieces of fruit? 

11 . Using generating functions, find the number of ways to make change for a $100 
bill using only dollar coins and $1, $2, and $5 bills. 

Hint. Find the partial fractions expansion for your generating function. Be careful 
here, as you want a partial fraction expansion in which all coefficients for your de- 
nominator polynomials have integer coefficients. If a computer algebra system gives 
you two denominators with irrational coefficients in them, combine them into a single 
term before proceeding. ( Matliematica ® has the Apart command, which produces the 


173 



Chapter 8 Generating Functions 


type of partial fractions expansion you want. WolframAlpha buries the "good one" far 
down the page.) Once you have the right partial fractions expansion, you may find the 
following identity helpful 

p(x ) p(x)( 1 - x) 

1 + X + X 2 + ■ • • + x k 1 - x k+1 
where p(x) will be a polynomial in this instance. 

12 . A businesswoman is traveling in Belgium and wants to buy chocolates for herself, 
her husband, and their two daughters. A store has dark chocolate truffles (€ 10 /box), 
milk chocolate truffles (€ 8/box), nougat-filled chocolates (€ 5/box), milk chocolate 
bars (€ 7/bar), and 75% cacao chocolate bars (€ 11 /bar). Her purchase is to be subject 
to the following: 

• Only the daughters like dark chocolate truffles, and her purchase must ensure 
that each daughter gets an equal number of boxes of them (if they get any). 

• At least two boxes of milk chocolate truffles must be purchased. 

• If she buys any boxes of nougat-filled chocolates, then she buys exactly enough 
that each family member gets precisely one box of them. 

• At most three milk chocolate bars may be purchased. 

• There are no restrictions on the number of 75% cacao chocolate bars. 

Let s n be the number of ways the businesswoman can spend exactly € n ( not buy n 
items!) at this chocolate shop. Find the generating function for the sequence { s „ : n > 
0}. In how many ways can she spend exactly € 100 at the chocolate shop? (A computer 
algebra system will be helpful for finding coefficients.) 

13. Bags of candy are being prepared to distribute to the children at a school. The 
types of candy available are chocolate bites, peanut butter cups, peppermint candies, 
and fruit chews. Each bag must contain at least two chocolate bites, an even number of 
peanut butter cups, and at most six peppermint candies. The fruit chews are available 
in four different flavors — lemon, orange, strawberry, and cherry. A bag of candy may 
contain at most two fruit chews, which may be of the same or different flavors. Beyond 
the number of pieces of each type of candy included, bags of candy are distinguished 
by using the flavors of the fruit chews included, not just the number. For example, a 
bag containing two orange fruit chews is different from a bag containing a cherry fruit 
chew and a strawberry fruit chew, even if the number of pieces of each other type of 
candy is the same. 

(a) Let b n be the number of different bags of candy with n pieces of candy that can be 
formed subject to these restrictions. Find the generating function for the sequence 
{ b n : n > 0}. 
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(b) Suppose the school has 400 students and the teachers would like to ensure that 
each student gets a different bag of candy. However, they know there will be 
fights if the bags do not all contain the same number of pieces of candy What is 
the smallest number of pieces of candy they can include in the bags that ensures 
each student gets a different bag of candy containing the same number of pieces 
of candy? 

14 . Make up a combinatorial problem (similar to those found in this chapter) that 
leads to the generating function 

(1 + X 2 + x 4 )x 2 
(1 - x) 3 (l - x 3 )(l - X 10 ) 

15 . Tollbooths in Illinois accept all U.S. coins, including pennies. Carlos has a very 
large supply of pennies, nickels, dimes, and quarters in his car as he drives on a toll- 
way. He encounters a toll for $0.95 and wonders how many different ways he could 
use his supply of coins to pay the toll without getting change back. (A computer al- 
gebra system is probably the best way to get the required coefficient once you have a 
generating function, since you're not asked for the coefficient on x" .) 

(a) Use a generating function and computer algebra system to determine the number 
of ways Carlos could pay his $0.95 toll by dropping the coins together into the toll 
bin. (Assume coins of the same denomination cannot be distinguished from each 
other.) 

(b) Suppose that instead of having a bin into which motorists drop the coins to pay 
their toll, the coins must be inserted one-by-one into a coin slot. In this scenario, 
Carlos wonders how many ways he could pay the $0.95 toll when the order the 
coins are inserted matters. For instance, in the previous part, the use of three 
quarters and two dimes would be counted only one time. However, when the 
coins must be inserted individually into a slot, there are 10 = C(5, 2) ways to 
insert this combination. Use an exponential generating function and computer 
algebra system to determine the number of ways that Carlos could pay the $0.95 
toll when considering the order the coins are inserted. 

16 . List the partitions of 9. Write a D next to each partition into distinct parts and an 
O next to each partition into odd parts. 

17 . Use generating functions to find the number of ways to partition 10 into odd parts. 

18 . What is the smallest integer that can be partitioned in at least 1000 ways? How 
many ways can it be partitioned? How many of them are into distinct parts? (A com- 
puter algebra system will be helpful for this exercise.) 
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19. What is the generating function for the number of partitions of an integer into even 
parts? 

20. Find the exponential generating function (in closed form, not as an infinite sum) 
for each infinite sequence { a n : n > 0} whose general term is given below. 


(a) 

a„ =5 n 

(d) a n = n\ 

(b) 

a n = (— 1)”2" 

(e) a„ = n 

(c) 

a n = 3 n+1 

(f) a„ = l/(n + 1) 


21. For each exponential generating function below, give a formula in closed form for 
the sequence {a n : n > 0} it represents. 


(a) e 7x 

(b) x 2 e 3x 


(c) 


1 


1 + X 


(d) 


22. Find the coefficient on x 10 /10! in each of the exponential generating functions be- 
low. 


(a) e 3x 

e x - 

(b) — 

e x - 

(c) — 


(d) xe 3x - x 2 

(e) 1 


1 -2x 


(f) 


23. Find the exponential generating function for the number of strings of length n 
formed from the set {a ,h,c,d} if there must be at least one a and the number of c's 
must be even. Find a closed formula for the coefficients of this exponential generating 
function. 

24. Find the exponential generating function for the number of strings of length n 
formed from the set {a ,h,c,d} if there must be at least one a and the number of c's 
must be odd. Find a closed formula for the coefficients of this exponential generating 
function. 

25. Find the exponential generating function for the number of strings of length n 
formed from the set {a, b, c, d} if there must be at least one a, the number of b's must 
be odd, and the number of d's is either 1 or 2. Find a closed formula for the coefficients 
of this exponential generating function. 
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26 . Find the exponential generating function for the number of alphanumeric strings 
of length n formed from the 26 uppercase letters of the English alphabet and 10 decimal 
digits if 

• each vowel must appear at least one time; 

• the letter T must appear at least three times; 

• the letter Z may appear at most three times; 

• each even digit must appear an even number of times; and 

• each odd digit must appear an odd number of times. 

27 . Consider the inequality 

X\ + Xi + *3 + X4 < n 


where X\, x-i, Xj, x 4/ n >0 are all integers. Suppose also that *2 ^ 2, x$ is a multiple of 
4, and 1 < X4 < 3. Let c n be the number of solutions of the inequality subject to these 
restrictions. Find the generating function for the sequence {c n : n > 0} and use it to 
find a closed formula for c n . 

Hint. Yes, this is very close to Exercise 8.8.7. However, the bounds on x\ are different 
here. You might try using a computer algebra system to expedite finding the partial 
fractions expansion, which will have several terms whose power series you can work 
with quickly. For the term involving 1 /(I + x 2 ), work out the series by hand. You may 
find that your solution to this problem has two parts — one for when n is even and 
another for when n is odd. 
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CHAPTER 


Recurrence Equations 

We have already seen many examples of recurrence in the definitions of combinatorial 
functions and expressions. The development of number systems in Appendix B lays 
the groundwork for recurrence in mathematics. Other examples we have seen include 
the Collatz sequence of Example 1.8 and the binomial coefficients. In Chapter 3, we also 
saw how recurrences could arise when enumerating strings with certain restrictions, 
but we didn't discuss how we might get from a recursive definition of a function to an 
explicit definition depending only on n, rather than earlier values of the function. In 
this chapter, we present a more systematic treatment of recurrence with the end goal of 
finding closed form expressions for functions defined recursively — whenever possible. 
We will focus on the case of linear recurrence equations. At the end of the chapter, we 
will also revisit some of what we learned in Chapter 8 to see how generating functions 
can also be used to solve recurrences. 


9.1 Introduction 

9.1.1 Fibonacci numbers 

One of the most well-known recurrences arises from a simple story. Suppose that a 
scientist introduces a pair of newborn rabbits to an isolated island. This species of 
rabbits is unable to reproduce until their third month of life, but after that produces a 
new pair of rabbits each month. Thus, in the first and second months, there is one pair 
of rabbits on the island, but in the third month, there are two pairs of rabbits, as the 
first pair has a pair of offspring. In the fourth month, the original pair of rabbits is still 
there, as is their first pair of offspring, which are not yet mature enough to reproduce. 
However, the original pair gives birth to another pair of rabbits, meaning that the island 
now has three pairs of rabbits. Assuming that there are no rabbit-killing predators on 
the island and the rabbits have an indefinite lifespan, how many pairs of rabbits are on 
the island in the tenth month? 

Let's see how we can get a recurrence from this story. Let /„ denote the number of 
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pairs rabbits on the island in month n. Thus, f\ = 1, f 2 = 1, /3 = 2, and fn = 3 from 
our account above. How can we compute /„? Well, in the n th month we have all the 
pairs of rabbits that were there during the previous month, which is however, 
some of those pairs of rabbits also reproduce during this month. Only the ones who 
were born prior to the previous month are able to reproduce during month n, so there 
are /„_ 2 pairs of rabbits who are able to reproduce, and each produces a new pair of 
rabbits. Thus, we have that the number of rabbits in month n is /„ = /„_ 1 + /„_ 2 for 
n > 3 with fi=f 2 = 1. The sequence of numbers { f„ : 11 > 0 } (we take fo = 0, which 
satisfies our recurrence) is known as the Fibonacci sequence after Leonardo of Pisa, 
better known as Fibonacci, an Italian mathematician who lived from about 1170 until 
about 1250. The terms /o, / 1 , ■ ■ • , /20 of the Fibonacci sequence are 

0, 1, 1, 2, 3, 5, 8, 13, 21, 34, 55, 89, 144, 233, 377, 610, 987, 1597, 2584, 4181, 6765. 

Thus, the answer to our question about the number of pairs of rabbits on the island 
in the tenth month is 55. That's really easy to compute, but what if we asked for the 
value of /1000 i n the Fibonacci sequence? Could you even tell whether the following 
inequality is true or false — without actually finding / 1000 ? 

/1000 < 232748383849990383201823093383773932 
Consider the sequence {f n +i/fn '■ 11 > 1} of ratios of consecutive terms of the Fi- 


bonacci sequence. Figure 9.1 shows these ratios for n < 18. 

1/1 = 1.0000000000 

89/55 = 1.6181818182 

2/1 = 2.0000000000 

144/89 = 1.6179775281 

3/2 = 1.5000000000 

233/144 = 1.6180555556 

5/3 = 1.666666666 7 

377/233 = 1.6180257511 

8/5 = 1.6000000000 

610/377 = 1.6180371353 

13/8 = 1.6250000000 

987/610 = 1.6180327869 

21/13 = 1.6153846154 

1597/987 = 1.6180344478 

34/21 = 1.6190476190 

2584/159 7 = 1.6180338134 

55/34 = 1.6176470588 

4181/2584 = 1.6180340557 


Figure 9.1: The ratios f n +i/fn for n <18 

The ratios seem to be converging to a number. Can we determine this number? Does 
this number have anything to do with an explicit formula for f n (if one even exists)? 


180 


9.1 Introduction 


Example 9.2. The Fibonacci sequence would not be as well-studied as it is if it were only 
good for counting pairs of rabbits on a hypothetical island. Here's another instance 
which again results in the Fibonacci sequence. Let c„ count the number of ways a 2 X n 
checkerboard can be covered by 2 x 1 tiles. Then c\ = 1 and ci = 2 while the recurrence 
is just c n+ 2 = c n+ 1 + c n , since either the rightmost column of the checkerboard contains 
a vertical tile (and thus the rest of it can be tiled in c n+ 1 ways) or the rightmost two 
columns contain two horizontal tiles (and thus the rest of it can be tiled in c n ways). 


9.1.2 Recurrences for strings 

In Chapter 3, we saw several times how we could find recurrences that gave us the 
number of binary or ternary strings of length n when we place a restriction on certain 
patterns appearing in the string. Let's recall a couple of those types of questions in 
order to help generate more recurrences to work with. 

Example 9.3. Let a n count the number of binary strings of length n in which no two 
consecutive characters are l's. Evidently, a\ = 2 since both binary strings of length 1 
are "good." Also, ci 2 = 3 since only one of the four binary strings of length 2 is "bad,", 
namely (1, 1). And = 5, since of the 8 binary strings of length 3, the following three 
strings are "bad": 

( 1 , 1 , 0 ), ( 0 , 1 , 1 ), ( 1 , 1 , 1 ). 

More generally, it is easy to see that the sequence satisfies the recurrence a n+ 2 = ci n + 1 + 
a n , since we can partition the set of all "good" strings into two sets, those ending in 0 
and those ending in 1 . If the last bit is 0, then in the first n + 1 positions, we can have 
any "good" string of length n + 1. However, if the last bit is 1, then the preceding bit 
must be 0, and then in the first n positions we can have any "good" string of length n . 

As a result, this sequence is just the Fibonacci numbers, albeit offset by 1 position, 
i.e, ci n = fn+i- 

Example 9.4. Let t n count the number of ternary strings in which we never have (2, 0) 
occurring as a substring in two consecutive positions. Now 1 1 = 3 and t 2 = 8, as of the 
9 ternary strings of length 2, exactly one of them is "bad." Now consider the set of all 
good strings grouped according to the last character. If this character is a 2 or a 1, then 
the preceding n + 1 characters can be any "good" string of length n + 1. However, if the 
last character is a 0, then the first n + 1 characters form a good string of length n + 1 
which does not end in a 2. The number of such strings is f )I+ i - t n . Accordingly, the 
recurrence is f „ + 2 = 3f„+i - t n . In particular, t$ = 21. 
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9.1.3 Lines and regions in the plane 

Our next example takes us back to one of the motivating problems discussed in Chap- 
ter 1. In Figure 9.5, we show a family of 4 lines in the plane. Each pair of lines intersects 
and no point in the plane belongs to more than two lines. These lines determine 11 re- 
gions. 



We ask how many regions a family of 1000 lines would determine, given these same 
restrictions on how the lines intersect. More generally, let r n denote the number of 
regions determined by n lines. Evidently, n = 2, rj = 4, r$ = 7 and r 4 = 11. Now it is 
easy to see that we have the recurrence r M+ i = r n + n + 1. To see this, choose any one of 
the n + 1 lines and call it l. Line 1 intersects each of the other lines and since no point 
in the plane belongs to three or more lines, the points where l intersects the other lines 
are distinct. Label them consecutively as X\, %i, . . . ,x n . Then these points divide line 
l into M + l segments, two of which (first and last) are infinite. Each of these segments 
partitions one of the regions determined by the other n lines into two parts, meaning 
we have the r n regions determined by the other n lines and n + 1 new regions that l 
creates. 


9.2 Linear Recurrence Equations 

What do all of the examples of the previous section have in common? The end result 
that we were able to achieve is a linear recurrence, which tells us how we can com- 
pute the n th term of a sequence given some number of previous values (and perhaps 
also depending nonrecursively on n as well, as in the last example). More precisely a 
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recurrence equation is said to be linear when it has the following form 

coa n +k + + C 2 a n+ k -2 H + Ckd„ = g(n), 

where k > 1 is an integer, Co, C\, . . . , Cjt are constants with Co, Cfc + 0, and g : Z —> R is a 
function. (What we have just defined may more properly be called a linear recurrence 
equation with constant coefficients, since we require the c, to be constants and prohibit 
them from depending on n . We will avoid this additional descriptor, instead choosing 
to speak of linear recurrence equations with nonconstant coefficients in case we allow 
the Ci to be functions of n . ) A linear equation is homogeneous if the function g(n ) on 
the right hand side is the zero function. For example, the Fibonacci sequence satisfies 
the homogeneous linear recurrence equation 

dn+2 ~ flii+1 — d n = 0. 

Note that in this example, k = 2, Co = 1 and c* = — 1. 

As a second example, the sequence in Example 9.4 satisfies the homogeneous linear 
recurrence equation 

t n +i ~~ 3f„+i + t n = 0. 

Again, k = 2 with Cq = Ck = 1. 

On the other hand, the sequence r n defined in Subsection 9.1.3 satisfies the nonho- 
mogeneous linear recurrence equation 

O+i -r„ = n+ 1. 

In this case, k = 1, Co = 1 and c* = — 1. 

Our immediate goal is to develop techniques for solving linear recurrence equations 
of both homogeneous and nonhomogeneous types. We will be able to fully resolve 
the question of solving homogeneous linear recurrence equations and discuss a sort of 
"guess-and-test" method that can be used to tackle the more tricky nonhomogeneous 
type. 

9.3 Advancement Operators 

Much of our motivation for solving recurrence equations comes from an analogous 
problem in continuous mathematics — differential equations. You don't need to have 
studied these beasts before in order to understand what we will do in the remainder 
of this chapter, but if you have, the motivation for how we tackle the problems will be 
clearer. As their name suggests, differential equations involve derivatives, which we 
will denote using "operator" notation by Df instead of the Leibniz notation df/dx. In 
our notation, the second derivative is D 2 /, the third is D 3 /, and so on. Consider the 
following example. 
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Example 9.6. Solve the equation 


if / (0) = 2. 


Df = 3f 


Solution. Even if you've not studied differential equations, you should recognize that 
this question is really just asking us to find a function / such that /( 0) = 2 and its 
derivative is three times itself. Let's ignore the initial condition /( 0) = 2 for the mo- 
ment and focus on the meat of the problem. What function, when you take its deriva- 
tive, changes only by being multiplied by 3? You should quickly think of the function 
e 3x , since D(e 3x ) = 3e 3x , which has exactly the property we desire. Of course, for any 
constant c, the function ce 3x also satisfies this property, and this gives us the hook we 
need in order to satisfy our initial condition. We have f(x) = ce 3x and want to find c 
such that /( 0) = 2. Now /( 0) = c • 1, so c = 2 does the trick and the solution to this 
very simple differential equation is f(x ) = 2e 3x . 


With differential equations, we apply the differential operator D to differentiable 
(usually infinitely differentiable) functions. For recurrence equations, we consider the 
vector space V whose elements are functions from the set Z of integers to the set C of 
complex numbers. We then consider a function A : V — > V , called the advancement 
operator, and defined by Af(n ) = f(n + 1). (By various tricks and sleight of hand, we 
can extend a sequence {a n : n > no} to be a function whose domain is all of Z, so this 
technique will apply to our problems.) More generally, A p f(n) = f(n + p) when p is a 
positive integer. 

Example 9.7. Let / e V be defined by f(n) = 7n - 9. Then we apply the advancement 
operator polynomial 3 A 2 - 5 A + 4 to / with n = 0 as follows: 


(3A 2 - 5A + 4)/(0) = 3/(2) - 5/(1) + 4/(0) = 3(5) - 5(-2) + 4(-9) = -11. 


As an analogue of Example 9.6, consider the following simple example involving the 
advancement operator. 

Example 9.8. Suppose that the sequence { s „ : n > 0} satisfies so = 3 and s )I+ i = 2s n 
for n > 1. Find an explicit formula for s„. 

Solution. First, let's write the question in terms of the advancement operator. We can 
define a function /(«) = s n for n > 0, and then the information given becomes that 
/( 0) = 3 and 

Af{n) = 2 /(«), n > 0. 

What function has the property that when we advance it, i.e., evaluate it at n + 1, it 
gives twice the value that it takes at n? The first function that comes into your mind 
should be 2" . Of course, just like with our differential equation, for any constant c, c2 n 
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also has this property. This suggests that if we take /(«) = c2", we're well on our way 
to solving our problem. Since we know that /( 0) = 3, we have /( 0) = c2° = c, so c = 3. 
Therefore, s n = f(n ) =3-2" for n > 0. This clearly satisfies our initial condition, and 
now we can check that it also satisfies our advancement operator equation: 

Af(n ) = 3 • 2 n+1 = 3 • 2 • 2 n = 2 • (3 • 2") = 2 • f(n). 

Before moving on to develop general methods for solving advancement operator 
equations, let's say a word about why we keep talking in terms of operators and men- 
tioned that we can view any sequence as a function with domain Z. If you've stud- 
ied any linear algebra, you probably remember learning that the set of all infinitely- 
differentiable functions on the real line form a vector space and that differentiation is a 
linear operator on those functions. Our analogy to differential equations holds up just 
fine here, and functions from Z to C form a vector space and A is a linear operator on 
that space. We won't dwell on the technical aspects of this, and no knowledge of linear 
algebra is required to understand our development of techniques to solve recurrence 
equations. However, if you're interested in more placing everything we do on rigorous 
footing, we discuss this further in Section 9.5. 

9.3.1 Constant Coefficient Equations 

It is easy to see that a linear recurrence equation can be conveniently rewritten using a 
polynomial p(A) of the advancement operator: 

p{A)f = (c 0 A k + ciA ,c_1 + c 2 A k ~ 2 + ■■■ + c k )f = g. (9.3.1) 

In (9.3.1), we intend that k > 1 is an integer, g is a fixed vector (function) from V , and 
Co, ci, . . . , Ck are constants with Co, cy + 0. Note that since Co + 0, we can divide both 
sides by Co, i.e., we may in fact assume that Co = 1 whenever convenient to do so. 

9.3.2 Roots and Factors 

The polynomial p(A) can be analyzed like any other polynomial. It has roots and fac- 
tors, and although these may be difficult to determine, we know they exist. In fact, if 
the degree of p(A) is k, we know that over the field of complex numbers, p(A) has k 
roots, counting multiplicities. Note that since we assume that c* h 0, all the roots of 
the polynomial p are non-zero. 

9.3.3 What’s Special About Zero? 

Why have we limited our attention to recurrence equations of the form p(A)f = g 
where the constant term in p is non-zero? Let's consider the alternative for a moment. 
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Suppose that the constant term of p is zero and that 0 is a root of p of multiplicity 
m. Then p(A) = A m q(A) where the constant term of q is non-zero. And the equation 
p(A)f = g can then be written as A m q(A)f = g. To solve this equation, we consider 
instead the simpler problem q(A)f = g. Then h is a solution of the original problem 
if and only if the function h' defined by h'(n ) = h(n + m) is a solution to the simpler 
problem. In other words, solutions to the original problem are just translations of solu- 
tions to the smaller one, so we will for the most part continue to focus on advancement 
operator equations where p(A) has nonzero constant term, since being able to solve 
such problems is all we need in order to solve the larger class of problems. 

As a special case, consider the equation A m f = g. This requires f(n + m) = g(n), 
i.e., / is just a translation of g. 


9.4 Solving advancement operator equations 

In this section, we will explore some ways of solving advancement operator equations. 
Some we will make up just for the sake of solving, while others will be drawn from 
the examples we developed in Section 9.1. Again, readers familiar with differential 
equations will notice many similarities between the techniques used here and those 
used to solve linear differential equations with constant coefficients, but we will not 
give any further examples to make those parallels explicit. 

9.4.1 Homogeneous equations 

Homogeneous equations, it will turn out, can be solved using very explicit method- 
ology that will work any time we can find the roots of a polynomial. Let's start with 
another fairly straightforward example. 

Example 9.9. Find all solutions to the advancement operator equation 

(A 2 + A - 6)f = 0. (9.4.1) 

Solution. Before focusing on finding all solutions as we've been asked to do, let's just 
try to find some solution. We start by noticing that here p(A) = A 2 +A— 6 = (A+3)(A— 2). 
With p(A) factored like this, we realize that we've already solved part of this problem 
in Example 9.8! In that example, the polynomial of A we encountered was (while not 
explicitly stated as such there) A - 2. The solutions to (A - 2)/i = 0 are of the form 
fi(n) = c i2" . What happens if we try such a function here? We have 

(A + 3)(A - 2)/i(n) = (A + 3)0 = 0, 
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so that /i is a solution to our given advancement operator equation. Of course, it can't 
be all of them. However, it's not hard to see now that ( A + 3)/2 = 0 has as a solution 
f 2 (n) = c 2 (-3)" by the same reasoning that we used in Example 9.8. Since ( A + 3)(A - 
2) = (A — 2)(A + 3), we see right away that f 2 is also a solution of Equation (9.4.1). 

Now we've got two infinite families of solutions to Equation (9.4.1). Do they give us 
all the solutions? It turns out that by combining them, they do in fact give all of the 
solutions. Consider what happens if we take f(n) = c{2 n + c 2 (— 3)" and apply p(A) to 
it. We have 

(A + 3 )(A - 2 )/(«) = (A + 3)(ci2' ,+1 + c 2 (-3)" +1 - 2(ci2' 1 + c 2 (-3)'')) 

= (A + 3)(-5c 2 (-3) >! ) 

= -5c 2 (-3)' !+1 - 15c 2 (-3)” 

= 15c 2 (-3)” - 15c 2 (-3)" 

= 0 . 


It's not all that hard to see that since / gives a two-parameter family of solutions to 
Equation (9.4.1), it gives us all the solutions, as we will show in detail in Section 9.5. 

What happened in this example is far from a fluke. If you have an advancement 
operator equation of the form p(A)f = 0 (the constant term of p nonzero) and p has 
degree k, then the general solution of p{A)f = 0 will be a A: -parameter family (in the 
previous example, our parameters are the constants C\ and c 2 ) whose terms come from 
solutions to simpler equations arising from the factors of p. We'll return to this thought 
in a little bit, but first let's look at another example. 

Example 9.10. Let's revisit the problem of enumerating ternary strings of length n that 
do have (2, 0) occurring as a substring in two consecutive positions that we encountered 
in Example 9.4. There we saw that this number satisfies the recurrence equation 

tn+ 2 = 3t n+ i — t n , n >1 


and 1 1=3 and f 2 = 8. Before endeavoring to solve this, let's rewrite our recurrence 
equation as an advancement operator equation. This gives us 


p(A)t = (A 2 - 3A + 1 )t = 0. 


(9.4.2) 


The roots of p(A) are (3 ± V5)/2. 
our general solution is 


Following the approach of the previous example. 


t(n) = ci 
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This probably looks suspicious; we're counting strings here, so t(n) needs to be a non- 
negative integer, but the form we've given includes not just fractions but also square 
roots! However, if you look carefully, you'll see that using the binomial theorem to 
expand the terms in our expression for t(n) would get rid of all the square roots, so 
everything is good. (A faster way to convince yourself that this really satisfies Equa- 
tion (9.4.2) is to mimic the verification we used in the previous example.) Because we 
have initial values for t(n), we are able to solve for ci and C 2 here. Evaluating at n = 0 
and n = 1 we get 


3 = Cl + C2 

q 3 + V5 _ 3-V5 

8 — Cl — h C2 r • 


A little bit of computation gives 


7V5 3 , 7V 5 3 

c i = —— + - and Ci = — + - 

10 2 10 2 


so that 


,( " ) = ll0- + 2 


7V 5 3\/3 + V5 


7V 5 3 \ / 3 — V5\” 


10 + 2 


Example 9.11. Find the general solution to the advancement operator equation 

(A + l)(A - 6)(A + 4)/ = 0. 


Solution. By now, you shouldn't be surprised that we immediately make use of the 
roots of p(A) and have that the solution is 

/(n) = ci(-l) n +C 2 6" +c 3 (-4) n . 

By now, you should be able to see most of the pattern for solving homogeneous ad- 
vancement operator equations. However, the examples we've considered thus far have 
all had one thing in common: the roots of p(A) were all distinct. Solving advancement 
operator equations in which this is not the case is not much harder than what we've 
done so far, but we do need to treat it as a distinct case. 

Example 9.12. Find the general solution of the advancement operator equation 

(A - iff = 0. 


Solution. Here we have the repeated root problem that we mentioned a moment ago. 
We see immediately that f\(n) = c{l n is a solution to this equation, but that can't be all. 
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as we mentioned earlier that we must have a 2-parameter family of solutions to such 
an equation. You might be tempted to try f 2 (n) = and f(n) = fi(n) + fiin), but 
then this is just (ci + C2)2 n , which is really just a single parameter, c = C\+ C2- 

What can we do to resolve this conundrum? What if we tried fi(n) = C2«2"? Again, 
if you're familiar with differential equations, this would be the analogous thing to try, 
so let's give it a shot. Let's apply ( A - 2) 2 to this f 2 - We have 

(A - 2 ff 2 {n) = (A- 2 )(c 2 (n + 1)2" +1 - 2c 2 n2 n ) 

= {A- 2)(c 2 2” +1 ) 

= c 2 2" +2 - 2 c 2 2' ,+1 
= 0 . 

Since /2 satisfies our advancement operator equation, we have that the general solution 
is 

f(n) = Ci 2 " + C 2 « 2 ". 

Example 9.13. Consider the recurrence equation 

fn+i = ~2fn+ 3 + 12 fn+2 "+ 1 4 fn+1 +5_/n 

with initial conditions fo = 1, /i = 2, /2 = 4, and = 4. Find an explicit formula for 

fn- 

Solution. We again start by writing the given recurrence equation as an advancement 
operator equation for a function /(«): 

(A 4 + 2A 3 - 12A 2 + 14A - 5)/ = 0. (9.4.3) 

Factoring p(A) = A 4 + 2A 3 - 12A 2 + 14A - 5 gives p(A) = (A + 5)(A - l) 3 . Right 
away, we see that /i(ft) = c’ i (-5)" is a solution. The previous example should have you 
convinced that /2(«) = C 2 ■ 1" = C 2 and f?,(n) = c^n ■ 1" = C3« are also solutions, and 
it's not likely to surprise you when we suggest trying fi(n) = C 4 I 1 2 as another solution. 
To verify that it works, we see 

(A + 5)(A - l) 3 /4(«) = (A + 5)(A - 1) 2 (c 4(« + l) 2 - c^n 2 ) 

= (A + 5)(A - 1 ) 2 ( 2 c 4 « + C 4 ) 

= (A + 5)(A - 1)(2c 4 (« + 1) + C4 - 2 c 4« - c 4 ) 

= {A+ 5)(A - 1)(2c 4 ) 

= (A + 5)(2c 4 - 2c 4 ) 

= 0 . 
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Thus, the general solution is 

fin) = ci(-5)" + C 2 + c$n + an 2 . 

Since we have initial conditions, we see that 

1 = /( 0) = C1 + C 2 

2 = /' ( 1 ) = — 5ci + C2 4- C3 4- C4 

4 = / (2) = 25ci + C2 + 2c 3 4- 4 c4 
4 = /(3) = -125ci + C2 + 3c 3 + 9c 4 

is a system of equations whose solution gives the values for the c, . Solving this system 
gives that the desired solution is 


,, , 1 , c .„ 71 5 1 2 

fin) = -(-5)” 4- — 4- -n + -n . 
J 72 72 6 4 


9.4.2 Nonhomogeneous equations 

As we mentioned earlier, nonhomogeneous equations are a bit trickier than solving 
homogeneous equations, and sometimes our first attempt at a solution will not be suc- 
cessful but will suggest a better function to try Before we're done, we'll revisit the 
problem of lines in the plane that we've considered a couple of times, but let's start 
with a more illustrative example. 

Example 9.14. Consider the advancement operator equation 

(A + 2)(A - 6)f = 3 n . 

Let's try to find the general solution to this, since once we have that, we could find the 
specific solution corresponding to any given set of initial conditions. 

When dealing with nonhomogeneous equations, we proceed in two steps. The rea- 
son for this will be made clear in Lemma 9.20, but let's focus on the method for the 
moment. Our first step is to find the general solution of the homogeneous equation 
corresponding to the given nonhomogeneous equation. In this case, the homogeneous 
equation we want to solve is 


{A + 2){A - 6)/ = 0, 

for which by now you should be quite comfortable in rattling off a general solution of 

/i(n) = c 1 (-2)» + c 2 6". 
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Now for the process of actually dealing with the nonhomogeneity of the advance- 
ment operator equation. It actually suffices to find any solution of the nonhomoge- 
neous equation, which we will call a particular solution. Once we have a particular 
solution /o to the equation, the general solution is simply / = /o + /i, where f\ is the 
general solution to the homogeneous equation. 

Finding a particular solution /o is a bit trickier than finding the general solution of 
the homogeneous equation. It's something for which you can develop an intuition by 
solving lots of problems, but even with a good intuition for what to try, you'll still likely 
find yourself having to try more than one thing on occasion in order to get a particular 
solution. What's the best starting point for this intuition? It turns out that the best 
thing to try is usually (and not terribly surprisingly) something that looks a lot like the 
right hand side of the equation, but we will want to include one or more new constants 
to help us actually get a solution. Thus, here we try fo(n) = d3" . We have 

(A + 2){A - 6)/o(n) = (A + 2){d3 n+1 - 6d3") 

= (A + 2)(-d3 n+1 ) 

= ~d3 n+1 - 2d3 n+1 
= -5d3 n+1 . 

We want /q to be a solution to the nonhomogeneous equation, meaning that {A + 2)(A - 
6 )/o = 3”. This implies that we need to take d = -1/15. Now, as we mentioned earlier, 
the general solution is 

fin ) = foin) + fi(n) = ~3 n + d(-2 :)» + c 2 6”. 

15 

We leave it to you to verify that this does satisfy the given equation. 

You hopefully noticed that in the previous example, we said that the first guess to 
try for a particular solution looks a lot like right hand side of the equation, rather than 
exactly like. Our next example will show why we can't always take something that 
matches exactly. 

Example 9.15. Find the solution to the advancement operator equation 

(A + 2)(A - 6)/ = 6" 

if /( 0) = 1 and /( 1) = 5. 

Solution. The corresponding homogeneous equation here is the same as in the pre- 
vious example, so its general solution is again fi(n) = Ci(-2)' ! + C 26 ". Thus, the real 
work here is finding a particular solution /o to the given advancement operator equa- 
tion. Let's just try what our work on the previous example would suggest here, namely 
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fo(n ) = d6" . Applying the advancement operator polynomial (A + 2)(A - 6) to /o then 
gives, uh, well, zero, since ( A - 6)(d6 n ) = d6 n+1 — 6d6 n = 0. Huh, that didn't work 
out so well. However, we can take a cue from how we tackled homogeneous advance- 
ment operator equations with repeated roots and introduce a factor of n. Let's try 
fo(n) = dn 6 ”. Now we have 

(A + 2)(A - 6)(dn6 n ) = (A + 2 )(d(n + 1 ) 6" +1 - 6dn6 n ) 

= (A + 2)d6" +l 
= d6 n+2 + 2d6 n+1 
= 6’\36d + 12d) = A8d6 n . 


We want this to be equal to 6”, so we have d = 1/48. Therefore, the general solution is 

f ( n ) = + ci(-2) n + c 2 6". 

All that remains is to use our initial conditions to find the constants Ci and c 2 . We 
have that they satisfy the following pair of equations: 


1 = Cl + c 2 

1 

5 = - - 2c! + 6c 2 


Solving these, we arrive at the desired solution, which is 


+ + l I 6 ”- 


What's the lesson we should take away from this example? When making a guess at 
a particular solution of a nonhomogeneous advancement operator equation, it does us 
no good to use any terms that are also solutions of the corresponding homogeneous 
equation, as they will be annihilated by the advancement operator polynomial. Let's 
see how this comes into play when finally resolving one of our longstanding examples. 

Example 9.16. We're now ready to answer the question of how many regions are de- 
termined by n lines in the plane in general position as we discussed in Subsection 9.1.3. 
We have the recurrence equation 


r n + 1 = r„ + n + 1 , 

which yields the nonhomogeneous advancement operator equation (A -l)r = n+ 1. As 
usual, we need to start with the general solution to the corresponding homogeneous 
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equation. This solution is fi(n) = C\. Now our temptation is to try fo(n) = din + di 
as a particular solution. However since the constant term there is a solution to the 
homogeneous equation, we need a bit more. Let's try increasing the powers of n by 1, 
giving fo(n) = din 2 + Now we have 

(. A - l)(din 2 + d 2 ti) = di{n + l) 2 + dz(n + 1) - din 2 - d 2 « 

= 2 din + di 4 - ^ 2 * 


This tells us that we need di = l/ 2 andd 2 = 1/2, giving fo(n) = n 2 /2 + n/2. The general 
solution is then 


fin ) = ci + 


n 2 + n 


What is our initial condition here? Well, one line divides the plane into two regions, 
so /( 1) = 2. On the other hand, /( 1) = ci + 1, so Ci = 1 and thus 


fin) = 1 + 


n 2 + n 


n + 1 


+ 1 


is the number of regions into which the plane is divided by n lines in general position. 

We conclude this section with one more example showing how to deal with a nonho- 
mogeneous advancement operator equation in which the right hand side is of "mixed 
type". 

Example 9.17. Give the general solution of the advancement operator equation 

(A -2) 2 / = 3” +2 n. 


Solution. Finding the solution to the corresponding homogeneous equation is get- 
ting pretty easy at this point, so just note that 

fiin ) = Ci 2 ” + c 2 m 2 ”. 

What should we try as a particular solution? Fortunately, we have no interference 
from p(A) = (A - 2 ) 2 here. Our first instinct is probably to try /o(n) = di3 n + d 2 n. 
However, this won't actually work. (Try it. You wind up with a leftover constant term 
that you can't just make zero.) The key here is that if we use a term with a nonzero 
power of n in it, we need to include the lower order powers as well (so long as they're 
not superfluous because of pM)). Thus, we try 

fo(n) — di 3 n + ^ 2 ^ ^ 3 . 
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This gives 

(A - 2) 2 (di3" + d 2 n + d 3 ) = (A - 2)(d 1 3 n+1 + d 2 (n + 1) + d 3 - 2d x 3 n - 2 d 2 n - 2 d 3 ) 

— (A — 2)(di3 n — dzvi -\- d-2 — d 3) 

= d\3 n+l — d2(yi + 1) + — do, — 2d\3 n + 2d2^i — 2d2 + 2d$ 

= d\ 3 11 + d2^i — 2d 2 + d^. 

We want this to be 3 n + 2n, so matching coefficients gives d\ — 1, d 2 = 2, and d$ = 4. 
Thus, the general solution is 

f(n) = 3 n + 2n + 4 + ci2 M + C2n2 n . 

9.5 Formalizing our approach to recurrence equations 

So far, our approach to solving recurrence equations has been based on intuition, and 
we've not given a lot of explanation for why the solutions we've given have been the 
general solution. In this section, we endeavor to remedy this. Some familiarity with 
the language of linear algebra will be useful for the remainder of this section, but it is 
not essential. 

Our techniques for solving recurrence equations have their roots in a fundamentally 
important concept in mathematics, the notion of a vector space. Recall that a vector 
space 1 consists of a set V of elements called vectors; in addition, there is a binary op- 
eration called addition with the sum of vectors x and y denoted by x + y; further- 
more, there is an operation called scalar multiplication which combines a scalar (real 
number) a and a vector x to form a product denoted ax. These operations satisfy the 
following properties: 

1. x + y = y + x for every x, y , e V. 

2. x + (y + z) = (x + y) + z, for every x,y ,z e V. 

3. There is a vector called zero and denoted 0 so that x +0 = x for every x e V. Note: 
We are again overloading an operator and using the symbol 0 for something other 
than a number. 

4. For every element x e V, there is an element y e V, called the additive inverse 
of x and denoted —x so that x + (~x) = 0. This property enables us to define 
subtraction, i.e., x - y = x + (-y). 

1 To be more complete, we should say that we are talking about a vector space over the field of real numbers, 

but in our course, these are the only kind of vector spaces we will consider. For this reason, we just use 
the short phrase "vector space". 
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5. lx = x for every x e X. 

6. a(/3x) = (afl)x, for every a, (1 e R and every x e V. 

7. a(x + y) = ax + ay for every a e R and every x,y e V. 

8. ( a + f)x = ax + fix, for every a, f> e R and every x eV. 

When V is a vector space, a function <p : V — » V is called an linear operator, or just 
operator for short, when cp(x + y) = cp(x) + (p(y) and cp(ax) = acp(x). When cp : V — » V 
is an operator, it is customary to write (px rather than <p(x), saving a set of parentheses. 
The set of all operators over a vector space V is itself a vector space with addition 
defined by (cp + p)x = (px + px and scalar multiplication by ( a<p)x = a((px). 

In this chapter, we focus on the real vector space V consisting of all functions of the 
form /: Z -+ R Addition is defined by (/ + c])(n) = f(n) + y{n) and scalar multipli- 
cation is defined by (a/)(«) = a(/(n)). 


9.5.1 The Principal Theorem 

Here is the basic theorem about solving recurrence equations (stated in terms of ad- 
vancement operator equations) — and while we won't prove the full result, we will pro- 
vide enough of an outline where it shouldn't be too difficult to fill in the missing details. 

Theorem 9.18. Let kbea positive integer k, and let co, ci, . . . , c\ he constants with Co, c* + 0. 
Then the set W of all solutions to the homogeneous linear equation 

(coA k + ciA k ' + C2A k ^ + • • • + C]<)f = 0 (9.5.1) 

is a k-dimensional subspace ofV. 

The conclusion that the set W of all solutions is a subspace of V is immediate, since 

P(A)if + y) = p(A)f + p(A)y and p(a)(af) = ap(A)(f). 

What takes a bit of work is to show that W is a k-dimensional subspace. But once 
this is done, then to solve the advancement operator equation given in the form of 
Theorem 9.18, it suffices to find a basis for the vector space W. Every solution is just 
a linear combination of basis vectors. In the next several subsections, we outline how 
this goal can be achieved. 
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9.5.2 The Starting Case 

The development proceeds by induction (surprise!) with the case k = 1 being the base 
case. In this case, we study a simple equation of the form (cqA + cf)f = 0. Dividing 
by Co and rewriting using subtraction rather than addition, it is clear that we are just 
talking about an equation of the form ( A - r)f = 0 where r y 0. 

Lemma 9.19. Let r + 0, and let f be a solution to the operator equation ( A - r)f = 0 .If 
c = /( 0), then f(n ) = cr n for every n e Z. 

Proof. We first show that f(n) = cr n for every n > 0, by induction on n. The base case 
is trivial since c = /( 0) = cr°. Now suppose that f(k) = cr k for some non-negative 
integer k. Then (A - r)f = 0 implies that f(k + 1) - rf(k) = 0, i.e., 

f(k + 1) = rf(k) = rcr k = cr k+1 . 

A very similar argument shows that /(— «) = cr~ n for every n < 0. □ 

Lemma 9.20. Consider a nonhomogeneous operator equation of the form 

p(A)f = ( c 0 A k + ciA k ~ x + c 2 A k ~ 2 + • • • + c k )f = g, (9.5.2) 

with Co, c k + 0, and let W be the subspace ofV consisting of all solutions to the corresponding 
homogeneous equation 

p(A)f = (coA k + ciA^ -1 + c 2 A k ~ 2 + ■ • • + cf)f = 0. (9.5.3) 

If fo is a solution to Equation (9.5.2), then every solution f to Equation (9.5.2) has the form 
f = fo + fi where f\ e W. 

Proof. Let / be a solution of Equation (9.5.2), and let fi = f — fo- Then 

K A )/i = P( A )(f ~ fo) = P(A)f - p(A)f 0 = g - g = 0. 

This implies that f\ £ W and that / = /o + /i so that all solutions to Equation (9.5.2) 
do in fact have the desired form. □ 

Using the preceding two results, we can now provide an outline of the inductive 
step in the proof of Theorem 9.18, at least in the case where the polynomial in the 
advancement operator has distinct roots. 

Theorem 9.21. Consider the following advancement operator equation 

p(A)f = (A - n)(A - r 2 ) ...(A- r k )f = 0. (9.5.4) 

with n, r 2 , . . . , r k distinct non-zero constants. Then every solution to Equation (9.5.4) has the 
form 

f(n) = cjr” + c 2 r” + c 3 r” + • ■ ■ + c k r". 
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Proof. The case k = 1 is Lemma 9.19. Now suppose we have established the theorem 
for some positive integer m and consider the case k = m + 1. Rewrite Equation (9.5.4) 
as 

( A - n)(A - r 2 ) ... (A - r m )[(A - r m+1 )f] = 0. 

By the inductive hypothesis, it follows that if / is a solution to Equation (9.5.4), then / 
is also a solution to the nonhomogeneous equation 

(A - r m +i)f = dir[ + d 2 r" + ■ ■ ■ + d m r" . (9.5.5) 

To find a particular solution fo to Equation (9.5.5), we look for a solution having the 
form 

fo(n) = cir" + c 2 r” + • • • + c m rf. (9.5.6) 

On the other hand, a simple calculation shows that for each i = 1,2 , ,m, we have 

(A - r m+ i)c,-r" = c,r" +1 - r m+1 ar" = cfr, - r m+1 )r”, 

so it suffices to choose a so that c,(r; - r m+ i) = d,, for each i = 1,2, ... , m. This can be 
done since r m+ i is distinct from r, for i = 1,2, ... m. 

Now we have a particular solution fo(n) = c ' r "- Next we consider the corre- 

sponding homogeneous equation (A-r m+ f)f = 0. The general solution to this equation 
has the form fi(n) = c m+ ir” +r It follows that every solution to the original equation 
has the form 


f(n) = fo(n) + fi(n) = c x r\ + c 2 r" + • ■ ■ + c m r n m + cr” +1 . 


which is exactly what we want! 


□ 


9.5.3 Repeated Roots 

It is straightforward to modify the proof given in the preceding section to obtain the 
following result. We leave the details as an exercise. 

Lemma 9.22. Let k > 1 and consider the equation 

(A - rff = 0. (9.5.7) 

Then the general solution to Equation (9.5.7) has the folloiving form 

f(n) = C\r n + c 2 nr n + C 2 ,n 2 r n + c±n?r n -4 + (9.5.8) 


197 


Chapter 9 Recurrence Equations 


9.5.4 The General Case 

Combining the results in the preceding sections, we can quickly write the general so- 
lution of any homogeneous equation of the form p(A)f = 0 provided we can factor the 
polynomial p(A). Note that in general, this solution takes us into the field of complex 
numbers, since the roots of a polynomial with real coefficients are sometimes complex 
numbers — with non-zero imaginary parts. 

We close this section with one more example to illustrate how quickly we can read 
off the general solution of a homogeneous advancement operator equation p(A)f = 0, 
provided that p(A) is factored. 

Example 9.23. Consider the advancement operator equation 

(A - 1) 5 (A + if {A - 3 f{A + 8)04 - 9 ) 4 / = 0. 

Then every solution has the following form 


f(n) =ci + c 7 n + c^n 2 + an 3 + C 5« 4 

+ c 6 (— 1)” + c 7 n(- l) n + c s n 2 (- 1 )'' 

+ c 9 3" + c 10 n3 n 
+ c n (-8)" 

+ ci29" + Ci3n9” + Ci4« 2 9" + cisn 3 9". 


9.6 Using generating functions to solve recurrences 

The approach we have seen thus far in this chapter is not the only way to solve recur- 
rence equations. Additionally, it really only applies to linear recurrence equations with 
constant coefficients. In the remainder of the chapter, we will look at some examples 
of how generating functions can be used as another tool for solving recurrence equa- 
tions. In this section, our focus will be on linear recurrence equations. In Section 9.7, 
we will see how generating functions can solve a nonlinear recurrence. 

Our first example is the homogeneous recurrence that corresponds to the advance- 
ment operator equation in Example 9.9. 

Example 9.24. Consider the recurrence equation r n + r n -\ - 6 r „_2 = 0 for the sequence 
{r n : n >0} with Vq = 1 and n = 3. This sequence has generating function 


oo 
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Now consider for a moment what the function xf(x) looks like. It has r n -\ as the 
coefficient on x n . Similarly, in the function - 6 x 2 f(x), the coefficient on x n is — 6 r„_ 2 . 

What is our point in all of this? Well, if we add them all up, notice what happens. 
The coefficient on x n becomes r n + r„_i - 6 r„_ 2 , which is 0 because of the recurrence 
equation! Now let's see how this all lines up: 

f(x) = ro + nx + r 2 x 2 + r$x 3 + ■ ■ • + r n x n + • • • 

xf(x) = 0 + yqx + r\x 2 + r 2 x 3 h r n - \x n + • • • 

- 6 x 2 f(x) - 0 + 0 - 6rox 2 - 6rix 3 H 6r n -2X n H 

When we add the left-hand side, we get /(x)( 1 + x — 6x 2 ). On the right-hand side, the 
coefficient on x n for n > 2 is 0 because of the recurrence equation. However, we are left 
with r o + ( J'o + J'| )x = 1 + Ax, using the initial conditions. Thus, we have the equation 

f(x)( 1 + x - 6x 2 ) = 1 + Ax, 

or f(x) = (1 4- 4x)/(l + x — 6 x 2 ). This is a generating function that we can attack using 
partial fractions, and we find that 


f(x) = 


6 1 
5 1 - 2x 


1 1 
5 1 + 3x 


oo oo 

£ 2 V--£(-3)" 


n = 0 


n= 0 


From here, we read off r n as the coefficient on x" and have r„ = (6/5)2” - (l/5)(-3)”. 

Although there's a bit more work involved, this method can be used to solve nonho- 
mogeneous recurrence equations as well, as the next example illustrates. 

Example 9.25. The recurrence equation r n - r„_i - 2 r „_2 = 2” is nonhomogeneous. Let 
r o=2 and ;'i = 1 . This time, to solve the recurrence, we start by multiplying both sides 
by x n . This gives the equation 

r n x n - r n - \x n - 2 r n - 2 X n = 2 n x n . 


If we sum this over all values of n > 2, we have 

OO oo oo oo 

^ r n x n - ^ rn^x" - 2 ^ r„_ 2 x" = ^ 2 n x n . 

n= 2 n-2 n = 2 n=2 

The right-hand side you should readily recognize as being almost equal to 1/(1 - 2x). 
We are missing the 1 and 2x terms, however, so must subtract them from the rational 
function form of the series. On the left-hand side, however, we need to do a bit more 
work. 
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The first sum is just missing the first two terms of the series, so we can replace it 
by R(x ) - (2 + x), where R(x) = r n x". The second sum is almost xR(x), except 
it's missing the first term. Thus, it's equal to xR(x ) - lx. The sum in the final term is 
simply x 2 R(x). Thus, the equation can be rewritten as 

9 1 

R(x) - (2 + x) - ( xR(x ) - 2x) - 2 x 2 R(x) = - — 1 - 2x. 


A little bit of algebra then gets us to the generating function 


R(x) = 


6x 2 — 5x + 2 
2(1 - 2x)(l - x - 2x 2 ) ’ 


This generating function can be expanded using partial fractions, so we have 

1 2 13 


R(x) = - 


9(1 - 2x) 3(1 - 2x) 2 9(1 + x) 

oo oo o° 


n = 0 


n — 0 


n = 0 


From this generating function, we can now read off that 


r n = -~2 n + +1) 2" + -(-If = -2" 

9 3 9 y 9 


2 13 

+ 3 « 2 " + -(-!)". 


The recurrence equations of the two examples in this section can both be solved using 
the techniques we studied earlier in the chapter. One potential benefit to the generating 
function approach for nonhomogeneous equations is that it does not require determin- 
ing an appropriate form for the particular solution. However, the method of generat- 
ing functions often requires that the resulting generating function be expanded using 
partial fractions. Both approaches have positives and negatives, so unless instructed 
to use a specific method, you should choose whichever seems most appropriate for 
a given situation. In the next section, we will see a recurrence equation that is most 
easily solved using generating functions because it is nonlinear. 


9.7 Solving a nonlinear recurrence 

In this section, we will use generating functions to enumerate the a certain type of trees. 
In doing this, we will see how generating functions can be used in solving a nonlinear 
recurrence equation. We will also make a connection to a counting sequence we en- 
countered back in Chapter 2. To do all of this, we must introduce a bit of terminology. 
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A tree is rooted if we have designated a special vertex called its root. We will always 
draw our trees with the root at the top and all other vertices below it. An unlabeled 
tree is one in which we do not make distinctions based upon names given to the ver- 
tices. For our purposes, a binary tree is one in which each vertex has 0 or 2 children, 
and an ordered tree is one in which the children of a vertex have some ordering (first, 
second, third, etc.). Since we will be focusing on rooted, unlabeled, binary, ordered 
trees (RUBOTs for short), we will call the two children of vertices that have children 
the left and right children. 

In Figure 9.26, we show the rooted, unlabeled, binary, ordered trees with n leaves 
for n < 4. 




Figure 9.26: The RUBOTs with n leaves for n < 4 

Let C(x) = X7=o c n x " be the generating function for the sequence { c„ : n >0} where 
c n is the number of RUBOTs with n leaves. (We take cq = 0 for convenience.) Then 
we can see from Figure 9.26 that C(x) = x + x 2 + 2x 3 + 5x 4 + ■ ■ ■. But what are the 
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remaining coefficients? Let's see how we can break a RUBOT with n leaves down into 
a combination of two smaller RUBOTs to see if we can express c n in terms of some for 
k < n. When we look at a RUBOT with n >2 leaves, we notice that the root vertex must 
have two children. Those children can be viewed as root nodes of smaller RUBOTs, say 
the left child roots a RUBOT with k leaves, meaning that the right child roots a RUBOT 
with n — k leaves. Since there are cjt possible sub-RUBOTs for the left child and c„_) t 
sub-RUBOTs for the right child, there are a total of CkC n -k RUBOTs in which the root's 
left child has k leaves on its sub-RUBOT. We can do this for any k = 1,2, . . . , n — 1, 
giving us that 

n — 1 

Cji = ^ ^ CkC n -k ■ 
k=l 

(This is valid since n > 2 .) Since Co = 0 , we can actually write this as 

n 

Cn = ^ CkC n -k- 

k= 0 

Let's look at the square of the generating function C(x). By Proposition 8 . 3 , we have 

C 2 (x) = Cq + (CoCl + C\Cq)x + (C0C2 + ClCl + C2Co)x 2 + •" 

= 0 + 0 + (C0C2 + ClCl + C2Co)x 2 + (C0C3 + C1C2 + C2C1 + C3Cq)x 3 + • • • . 

But now we see from our recursion above that the coefficient on x” in C 2 (x) is nothing 
but c n for n > 2 . All we're missing is the x term, so adding it in gives us that 

C(x) = x + C 2 (x). 

Now this is a quadratic equation in C(x), so we can solve for C(x) and have 

. 1 + Vl - 4 x 1 + (1 - 4 x) 1/2 

cw = — 2 — = 2 • 

Hence, we can use Newton's Binomial Theorem to expand C(x). To do so, we use 
the following lemma. Its proof is nearly identical to that of Lemma 8 . 11 , and is thus 
omitted. 

Lemma 9.27. For each k > 1, 


/l/2\ _ (-1)*- 2 (Tfl 

\ k ) k 2 2,c_1 ‘ 
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Now we see that 



Since we need c n > 0, we take the "minus" option from the "plus-or-minus" in the 
quadratic formula and thus have the following theorem. 

Theorem 9.28. The generating function for the number c„ of rooted, unlabeled, binary, ordered 
trees with n leaves is 



Notice that c n is a Catalan number, which we first encountered in Chapter 2, where 
we were counting lattice paths that did not cross the diagonal line y = x. (The coeffi- 
cient c n is the Catalan number we called C(n - 1) in Chapter 2.) 


9.8 Discussion 


Yolanda took a sip of coffee "I'm glad I paid attention when we were studying vector 
spaces, bases, and dimension. All this stuff about solutions for recurrence equations 
made complete sense. And I can really understand why the professor was making a 
big deal out of factoring. We saw it our first semester when we were learning about 
partial fractions in calculus. And we saw it again with the differential equations stuff. 
Isn't it really neat to see how it all fits together?" All this enthusiasm was too much 
for Alice who was not having a good day. Bob was more sympathetic, saying "Except 
for the detail about zero as a root of an advancement operator polynomial, I was ok 
with this chapter." Xing said "Here we learned a precise approach that depended only 
on factoring. I've been reading on the web and I see that there have been some recent 
breakthroughs on factoring." Bob jumped back in "But even if you can factor like crazy, 
if you have a large degree polynomial in the advancement operator equation, then 
you will have lots of initial conditions. This might be a second major hurdle." Dave 
mumbled "Just do the factoring. The rest is easy." Carlos again was quiet but he knew 
that Dave was right. Solving big systems of linear equations is relatively easy. The 
challenge is in the factoring stage. 
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9.9 Exercises 

1 . Write each of the following recurrence equations as advancement operator equa- 
tions. 

(a) r n+ 2 = r n+ \ + 2 r n (d) h„ = h n - 1 - lh n - 2 + h n - 3 

(b) r n+ 4 = 3r „ +3 - r n+2 + 2 r n (e) r n = 4r„_i + r „_ 3 - 3 r „- 5 + (-1)” 

(c) g n+ 3 = 5^„+i - g n + 3” (f) = fr„_i + 3b n - 2 + 2 " +1 - n 2 

2. Solve the recurrence equation r n+2 = r n+ \ + 2 r„ if ro = 1 and r 2 = 3 (Yes, we specify 
a value for ('2 but not for ri). 

3. Find the general solution of the recurrence equation g n+2 = 3g n+ \ - 2 g n . 

4. Solve the recurrence equation h n+ 3 = 6h n+2 - 1 1 h n+ \ + 6h n if /zq = 3, /q = 2, and 
/z 2 = 4. 

5. Find an explicit formula for the n lh Fibonacci number f„ . (See Subsection 9.1.1.) 

6 . For each advancement operator equation below, give its general solution. 

(a) (A - 2)(A + 10)/ = 0 (d) (A 3 - 4A 2 - 20 A + 48)/ = 0 

(b) (A 2 - 36) / = 0 (e) (A 3 +A 2 -5A+3)f = 0 

(c) (A 2 - 2A - 5)/ = 0 (f) (A 3 + 3A 2 + 3A + 1)/ = 0 

7. Solve the advancement operator equation (A 2 + 3 A - 10)/ = 0 if /( 0) = 2 and 

/(i) = 10 . 

8 . Give the general solution to each advancement operator equation below. 

(a) (A - 4 ) 3 (A + l)(A - Tf(A - 1 ) 2 / = 0 

(b) (A + 2 ) 4 (A - 3 ) 2 (A - 4 )(A + 7)(A - 5) 3 g = 0 

(c) (A - 5 ) 2 {A + 3) 3 (A - 1) 3 (A 2 - 1)(A - 4) 3 7z = 0 

9. For each nonhomogeneous advancement operator equation, find its general solu- 
tion. 
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(a) (A - 5)(A + 2)/ = 3" 


(f) {A + 2 )(A - 5 )(A - 1 )/ = 5" 

(g) (A - 3) 2 (A + l)g = 2-3” 


(b) (A 2 + 3A - % = 2" + (-1)" 


(c) (A - 3 ) 3 / = 3« + 1 

(d) (A 2 + 3A - \)g = In 


(h) (A - 2) (A + 3)/ = 5n2 n 


(i) (A - 2) 2 (A - l)g = 3« 2 2 f! + 2” 

(j) (A + 1) 2 (A - 3)/ = 3" + In 2 


(e) (A - 2)(A - 4)/ = 3 2 + 9 n 


10 . Find and solve a recurrence equation for the number g n of ternary strings of length 
n that do not contain 102 as a substring. 

1 1 . There is a famous puzzle called the Towers of Hanoi that consists of three pegs 
and n circular discs, all of different sizes. The discs start on the leftmost peg, with the 
largest disc on the bottom, the second largest on top of it, and so on, up to the smallest 
disc on top. The goal is to move the discs so that they are stacked in this same order on 
the rightmost peg. However, you are allowed to move only one disc at a time, and you 
are never able to place a larger disc on top of a smaller disc. Let t n denote the fewest 
moves (a move being taking a disc from one peg and placing it onto another) in which 
you can accomplish the goal. Determine an explicit formula for t n . 

12 . A valid database identifier of length n can be constructed in three ways: 

• Starting with A and followed by any valid identifier of length n - 1 . 

• Starting with one of the two-character strings 1A, IB, 1C, ID, IE, or IF and fol- 
lowed by any valid identifier of length n — 2. 

• Starting with 0 and followed by any ternary ({0, 1,2}) string of length n — 1. 

Find a recurrence for the number g(n ) of database identifiers of length n and then solve 
your recurrence to obtain an explicit formula for g(n). (You may consider the empty 
string of length 0 a valid database identifier, making £/ ( 0 ) = 1. This will simplify the 
arithmetic.) 

13 . Let t n be the number of ways to tile a 2 x n rectangle using lxl tiles and L-tiles. An 
L-tile is a 2 X 2 tile with the upper-right lxl square deleted. (An L tile may be rotated 
so that the "missing" square appears in any of the four positions.) Find a recursive 
formula for t n along with enough initial conditions to get the recursion started. Use 
this recursive formula to find a closed formula for f „ . 

14 . Prove Lemma 9.22 about advancement operator equations with repeated roots. 

15 . Use generating functions to solve the recurrence equation r n = r n -\ + 6r„_2 for 
n >2 with 7'o = 1 and r\ = 3. 
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16 . Let ao = 0, a \ = 2, and a 2 = 5. Use generating functions to solve the recurrence 
equation a n+ 3 = 5a n+ 2 - 7a n+ i + 3 a n + 2 " for n > 0 . 

17 . Let b 0 = 1, = U and L 3 = 4. Use generating functions to solve the recurrence 

equation b n+ 3 = 4 b „+2 - b n+ 1 - 6 fr„ + 3" for n > 0. 

18 . Use generating functions to find a closed formula for the Fibonacci numbers /„ . 

19 . How many rooted, unlabeled, binary, ordered, trees (RUBOTs) with 6 leaves are 
there? Draw 6 distinct RUBOTs with 6 leaves. 

20 . In this chapter, we developed a generating function for the Catalan numbers. We 
first encountered the Catalan numbers in Chapter 2, where we learned they count cer- 
tain lattice paths. Develop a recurrence for the number l n of lattice paths similar to the 
recurrence 


n 



for n >2 


k= 0 


for RUBOTs by thinking of ways to break up a lattice path from (0, 0) to (n , n ) that does 
not cross the diagonal y = x into two smaller lattice paths of this type. 
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It was a slow day and Dave said he was bored. It was just after lunch, and he com- 
plained that there was nothing to do. Nobody really seemed to be listening, although 
Alice said that Dave might consider studying, even reading ahead in the chapter. Un- 
deterred, Dave said "Hey Alice, how about we play a game. We could take turns toss- 
ing a coin, with the other person calling heads or tails. We could keep score with the 
first one to a hundred being the winner." Alice rolled her eyes at such a lame idea. 
Sensing Alice's lack of interest, Dave countered "OK, how about a hundred games of 
Rock, Paper or Scissors?" Zori said "Why play a hundred times? If that's what you're 
going to do, just play a single game." 

Now it was Alice's turn. "If you want to play a game. I've got a good one for you. 
Just as you wanted, first one to score a hundred wins. You roll a pair of dice. If you 
roll doubles, I win 2 points. If the two dice have a difference of one, I win 1 point. 
If the difference is 2, then it's a tie. If the difference is 3, you win one point; if the 
difference is 4, you win two points; and if the difference is 5, you win three points." 
Xing interrupted to say "In other words, if the difference is d, then Dave wins d - 2 
points." Alice continues "Right! And there are three ways Dave can win, with one of 
them being the biggest prize of all. Also, rolling doubles is rare, so this has to be a 
good game for Dave." 

Zori's ears perked up with Alice's description. She had a gut feeling that this game 
wasn't really in Dave's favor and that Alice knew what the real situation was. The idea 
of a payoff with some uncertainty involved seemed very relevant. Carlos was scribbling 
on a piece of paper, then said politely "Dave, you really should be reading ahead in the 
chapter". 

So what do you think? Is this a fair game? What does it mean for a game to be fair? 
Should Dave play — independent of the question of whether such silly stuff should oc- 
cupy one's time? And what does any of this conversation have to do with combina- 
torics? 
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10.1 An Introduction to Probability 

We continue with an informal discussion intended to motivate the more structured 
development that will follow. Consider the "spinner" shown in Figure 10.1. Suppose 
we give it a good thwack so that the arrow goes round and round. We then record 
the number of the region in which the pointer comes to rest. Then observers, none of 
whom have studied combinatorics, might make the following comments: 



Figure 10 . 1 : A Spinner for Games of Chance 


1. The odds of landing in region 1 are the same as those for landing in region 3. 

2. You are twice as likely to land in region 2 as in region 4. 

3. When you land in an odd numbered region, then 60% of the time, it will be in 
region 5. 

We will now develop a more formal framework that will enable us to make such 
discussions far more precise. We will also see whether Alice is being entirely fair to 
Bob in her proposed game to one hundred. 

We begin by defining a probability space as a pair ( S,P ) where S is a finite set and 
P is a function that whose domain is the family of all subsets of S and whose range is 
the set [0, 1] of all real numbers which are non-negative and at most one. Furthermore, 
the following two key properties must be satisfied: 

1. P(0) = 0 and P(S) = 1. 

2. If A and B are subsets of S, and A fi B =0, then P(A U B) = P(A) + P{B). 
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When (S, P) is a probability space, the function P is called a probability measure, 
the subsets of S are called events, and when £ c S, the quantity P(£) is referred to as 
the probability of the event E. 

Note that we can consider P to be extended to a mapping from S to [0, 1] by setting 
P(x) = P({x}) for each element x e S. We call the elements of S outcomes (some 
people prefer to say the elements are elementary outcomes) and the quantity P(x ) is 
called the probability of x. It is important to realize that if you know P(x) for each 
x e S, then you can calculate P(£) for any event £, since (by the second property), 

P(£) = Z re xf(4 

Example 10.2. For the spinner, we can take S = {1,2, 3, 4, 5}, withP(l) = P( 3) = P( 4) = 
1/8, P( 2) = 2/8 = 1/4 and P(5) = 3/8. So P({2,3}) = 1/8 + 2/8 = 3/8. 

Example 10.3. Let S be a finite, nonempty set and let n = |S|. For each E c S, set 
P(£) = \E\/n. In particular, P(x) = 1/n for each element x £ S. In this trivial example, 
all outcomes are equally likely. 

Example 10.4. If a single six sided die is rolled and the number of dots on the top face 
is recorded, then the ground set is S = {1, 2, 3,4, 5, 6} and P(z) = 1/6 for each i e S. On 
the other hand, if a pair of dice are rolled and the sum of the dots on the two top faces is 
recorded, then S = {2,3,4, ... , 11, 12} with P( 2) = P(12) = 1/36, P(3) = P(ll) = 2/36, 
P(4) = P(10) = 3/36, P( 5) = P( 9) = 4/36, P( 6) = P(8) = 5/36 and P(7) = 6/36. To see 
this, consider the two die as distinguished, one die red and the other one blue. Then 
each of the pairs ( i , j) with 1 < i, j < 6, the red die showing i spots and the blue die 
showing j spots is equally likely. So each has probability 1/36. Then, for example, 
there are three pairs that yield a total of four, namely (3, 1), (2,2) and (1,3). So the 
probability of rolling a four is 3/36 = 1/12. 

Example 10.5. In Alice's game as described above, the set S can be {0, 1, 2, 3,4, 5}, the 
set of possible differences when a pair of dice are rolled. In this game, we will see that 
the correct definition of the function P will set P(0) = 6/36; P(l) = 10/36; P( 2) = 8/36; 
P(3) = 6/36; P(4) = 4/36; and P(5) = 2/36. Using Xing's more compact notation, we 
could say that P( 0) = 1/6 and P(d) = 2(6 - d )/ 36 when d > 0. 

Example 10.6. A jar contains twenty marbles, of which six are red, nine are blue and 
the remaining five are green. Three of the twenty marbles are selected at random. 1 Let 
X = {0, 1, 2, 3, 4, 5}, and for each x e X, let P(x) denote the probability that the number 
of blue marbles among the three marbles selected is x. Then P(i) = C(9, z)C(ll,3 - 
z)/C( 20,3) for i = 0, 1,2,3, while P(4) = P(5) = 0. Bob says that it doesn't make sense 
to have outcomes with probability zero, but Carlos says that it does. 

1 This is sometimes called sampling without replacement. You should imagine a jar with opaque sides — so 
you can't see through them. The marbles are stirred /shaken, and you reach into the jar blind folded and 
draw out three marbles. 
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Example 10.7. In some cards games, each player receives five cards from a standard 
deck of 52 cards — four suits (spades, hearts, diamonds and clubs) with 13 cards, ace 
though king in each suit. A player has a full house if there are two values x and y 
for which he has three of the four x's and two of the four y's, e.g. three kings and two 
eights. If five cards are drawn at random from a standard deck, the probability of a full 
house is 

%)(t) 

52 3 2 ~ 0.00144. 

5 

10.2 Conditional Probability and Independent Events 

A jar contains twenty marbles of which six are red, nine are blue and the remaining five 
are green. While blindfolded, Xing selects two of the twenty marbles random (without 
replacement) and puts one in his left pocket and one in his right pocket. He then takes 
off the blindfold. 

The probability that the marble in his left pocket is red is 6/20. But Xing first reaches 
into his right pocket, takes this marble out and discovers that it is blue. Is the proba- 
bility that the marble in his left pocket is red still 6/20? Intuition says that it's slightly 
higher than that. Here's a more formal framework for answering such questions. 

Let (S, P) be a probability space and let B be an event for which P(B) > 0. Then for 
every event A c S, we define the probability of A, given B, denoted P(A|B) , by setting 
P(A|B) = P(AnB)/P(B). 

Discussion 10.8. Returning to the question raised at the beginning of the section. Bob 
says that this is just conditional probability. He says let B be the event that the marble 
in the right pocket is blue and let A be the event that the marble in the left pocket is red. 
Then P(B) = 9/20, P(A) = 6/20 and P(APB) = (9-6)/380,sothatP(A|B) = J|f = 6/19, 
which is of course slightly larger than 6/20. Alice is impressed. 

Example 10.9. Consider the jar of twenty marbles from the preceding example. A 
second jar of marbles is introduced. This jar has eighteen marbles: nine red, five blue 
and four green. A jar is selected at random and from this jar, two marbles are chosen at 
random. What is the probability that both are green? Bob is on a roll. He says "Let G 
be the event that both marbles are green, and let J\ and / 2 be the event that the marbles 
come from the first jar and the second jar, respectively. Then G = (G fl /i) U (G fl J 2 ), 
and (G Pi /i) + (G Pi J 2 ) = 0. Furthermore, P(G|/i) = )/( 2 2 °) and P(G|/ 2 ) = ( 2 )/( 2 8 )/ while 
P(Ji) = P(/ 2 ) = 1/2. Also P(G P Jt) = P(Ji)P(G\Ji) for each i = 1,2. Therefore," 




10.3 Bernoulli Trials 


That's about 4.6%." 

Now Alice is speechless. 

10.2.1 Independent Events 

Let A and B be events in a probability space ( S,P ). We say A and B are independent 
if P(A fl B) = P(A)P(B). Note that when P(B) + 0, A and B are independent if and 
only if P(A) = P(A |fi). Two events that are not independent are said to be dependent. 
Returning to our earlier example, the two events (A: the marble in Xing's left pocket is 
red and B : the marble in his right pocket is blue) are dependent. 

Example 10.10. Consider the two jars of marbles from Example 10.9. One of the two 
jars is chosen at random and a single marble is drawn from that jar. Let A be the event 
that the second jar is chosen, and let B be the event that the marble chosen turns out to 
be green. Then P(A ) = 1/2 and P(B) = 5^5 + On the other hand, P(A fl B) = 
so P{A n B) + P(A)P(B), and the two events are not independent. Intuitively, this 
should be clear, since once you know that the marble is green, it is more likely that you 
actually chose the first jar. 

Example 10.11. A pair of dice are rolled, one red and one blue. Let A be the event that 
the red die shows either a 3 or a 5, and let B be the event that you get doubles, i.e., the 
red die and the blue die show the same number. Then P(A) = 2/6, P(B) = 6/36, and 
P(A fl B) = 2/36. So A and B are independent. 


10.3 Bernoulli Trials 

Suppose we have a jar with 7 marbles, four of which are red and three are blue. A 
marble is drawn at random and we record whether it is red or blue. The probability p 
of getting a red marble is 4/7; and the probability of getting a blue is 1 — p = 3/7. 

Now suppose the marble is put back in the jar, the marbles in the jar are stirred, 
and the experiment is repeated. Then the probability of getting a red marble on the 
second trial is again 4/7, and this pattern holds regardless of the number of times the 
experiment is repeated. 

It is customary to call this situation a series of Bernoulli trials. More formally, we 
have an experiment with only two outcomes: success and failure. The probability 
of success is p and the probability of failure is 1 — p. Most importantly, when the 
experiment is repeated, then the probability of success on any individual test is exactly 

V- 

We fix a positive integer n and consider the case that the experiment is repeated n 
times. The outcomes are then the binary strings of length n from the two-letter alpha- 
bet {S, F}, for success and failure, respectively. If x is a string with i successes and n - i 
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failures, then P(x) = (")p l * (l-p) n Of course, in applications, success and failure may 
be replaced by: head/tails, up/ down, good/bad, forwards/backwards, red/blue, etc. 

Example 10.12. When a die is rolled, let's say that we have a success if the result is 
a two or a five. Then the probability p of success is 2/6 = 1/3 and the probability of 
failure is 2/3. If the die is rolled ten times in succession, then the probability that we 
get exactly four successes is C(10,4)(l/3) 4 (2/3) 6 . 

Example 10.13. A fair coin is tossed 100 times and the outcome (heads or tails) is 
recorded. Then the probability of getting heads 40 times and tails the other 60 times is 


I100\ / 

1 \ 40 / D 

|S 

i 

o 

\40jl 

21 \2; 

1 2 100 


Discussion 10.14. Bob says that if a fair coin is tossed 100 times, it is fairly likely that 
you will get exactly 50 heads and 50 tails. Dave is not so certain this is right. Carlos fires 
up his computer and in few second, he reports that the probability of getting exactly 
50 heads when a fair coin is tossed 100 times is 

12611418068195524166851562157 

158456325028528675187087900672 

which is .079589, to six decimal places. In other words, not very likely at all. Xing is 
doing a modestly more complicated calculation, and he reports that you have a 99% 
chance that the number of heads is at least 20 and at most 80. Carlos adds that when 
n is very large, then it is increasingly certain that the number of heads in n tosses will 
be close to n /2. Dave asks what do you mean by close, and what do you mean by very 
large? 


10.4 Discrete Random Variables 

Let (S, P) be a probability space and let X : S — » R be any function that maps the 
outcomes in S to real numbers (all values allowed, positive, negative and zero). We 
call 1 X a random variable. The quantity £ veS X(x)P(x), denoted £(X), is called the 
expectation (also called the mean or expected value) of the random variable X. As the 
suggestive name reflects, this is what one should expect to be the average behavior of 
the result of repeated Bernoulli trials. 

Note that since we are dealing only with probability spaces (S, P) where S is a finite 
set, the range of the probability measure P is actually a finite set. Accordingly, we can 
rewrite the formula for £(X) as £ v y ■ prob(X(x) = y), where the summation extends 
over a finite range of values for y. 

1 For historical reasons, capital letters, like X and Y are used to denote random variables. They are just 

functions, so letters like /, g and h might more seem more natural — but maybe not. 
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Example 10.15. For the spinner shown in Figure 10.1, let X(i ) = i 2 where i is the num- 
ber of the region. Then 

E(X) = V i 2 P(i) = l 2 l+l 2 -+3 2 l+4 2 -+5 2 l = — . 
y ' Z-j y J 8 8 8 8 8 8 

ieS 

Note that 109/8 = 13.625. The significance of this quantity is captured in the fol- 
lowing statement. If we record the result from the spinner n times in succession as 
(z’l, Z 2 , . . . , i n ) and Xing receives a prize worth i 2 for each j = 1,2,..., n), then Xing 
should "expect" to receive a total prize worth 109«/8 = 13. 625 w. Bob asks how this 
statement can possibly be correct, since 13.625n may not even be an integer, and any 
prize Xing receives will have integral value. Carlos goes on to explain that the concept 
of expected value provides a formal definition for what is meant by a fair game. If Xing 
pays 13.625 cents to play the game and is then paid i 2 pennies where i is the number 
of the region where the spinner stops, then the game is fair. If he pays less, he has an 
unfair advantage, and if he pays more, the game is biased against him. Bob says "How 
can Xing pay 13.625 pennies?" Brushing aside Bob's question, Carlos says that one can 
prove that for every e > 0, there is some iiq (which depends on e) so that if r i > no, 
then the probability that Xing's total winnings minus 13.625/1, divided by n is within e 
of 13.625 is at least 1 — e. Carlos turns to Dave and explains politely that this statement 
gives a precise meaning of what is meant by "close" and "large". 

Example 10.16. For Alice's game from the start of the chapter, S = {0, 1, 2, 3, 4, 5}, we 
could take X to be the function defined by X(d) =2 — d. Then X(d) records the amount 
that Bob wins when the difference is d (a negative win for Bob is just a win for Alice in 
the same amount). We calculate the expectation of X as follows: 

£(X) = 2 X M rn = -4 - ig + 4 + 4 + 3236 = i- 

d = 0 

Note that -2/36 = -.055555. . .. So if points were dollars, each time the game is played. 
Bob should expect to lose slightly more than a nickel. Needless to say, Alice likes to 
play this game and the more times Bob can be tricked into playing, the more she likes 
it. On the other hand, by this time in the chapter. Bob should be getting the message 
and telling Alice to go suck a lemon. 

10.4.1 The Linearity of Expectation 

The following fundamental property of expectation is an immediate consequence of 
the definition, but we state it formally because it is so important to discussions to follow. 
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Proposition 10.17. Let (S, P) be a probability space and let X\, X 2 , ... ,X n be random vari- 
ables. Then 


£(Xi + X 2 + • • • + Xf) = £(Xi) + £(X 2 ) + • ■ ■ + £(X„). 


10.4.2 Implications for Bernoulli Trials 

Example 10.18. Consider a series of n Bernoulli trials with p, the probability of success, 
and let X count the number of successes. Then, we claim that 

E(X) = J]ihp i (l-p) n - i = np 

To see this, consider the function f(x) = [px + (1 - p)] n . Taking the derivative by the 
chain rule, we find that f{x) = np[px + (1 - p)] n-1 . Now when x = 1, the derivative 
has value np. 

On the other hand, we can use the binomial theorem to expand the function /. 

f(x) = f j l n \x i p i (l-p) n - i 
1=0 ' > 


It follows that 

f\x) = Y j i( n \x i -p i {l-p) n - i 
i = 0 ' ' 

And now the claim follows by again setting x = 1. Who says calculus isn't useful! 

Example 10.19. Many states have lotteries to finance college scholarships or other pub- 
lic enterprises judged to have value to the public at large. Although far from a scientific 
investigation, it seems on the basis of our investigation that many of the games have an 
expected value of approximately fifty cents when one dollar is invested. So the games 
are far from fair, and no one should play them unless they have an intrinsic desire to 
support the various causes for which the lottery profits are targeted. 

By contrast, various games of chance played in gambling centers have an expected 
return of slightly less than ninety cents for every dollar wagered. In this setting, we 
can only say that one has to place a dollar value on the enjoyment derived from the 
casino environment. From a mathematical standpoint, you are going to lose. That's 
how they get the money to build those exotic buildings. 


10.5 Central Tendency 

Consider the following two situations: 
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• Situation 1. A small town decides to hold a lottery to raise funds for charitable 
purposes. A total of 10, 001 tickets are sold, and the tickets are labeled with num- 
bers from the set {0, 1, 2, ... , 10, 000}. At a public ceremony, duplicate tickets are 
placed in a big box, and the mayor draws the winning ticket from out of the box. 
Just to heighten the suspense as to who has actually won the prize, the mayor 
reports that the winning number is at least 7, 500. The citizens ooh and aah and 
they can't wait to see who among them will be the final winner. 

• Situation 2. Behind a curtain, a fair coin is tossed 10,000 times, and the number 
of heads is recorded by an observer, who is reputed to be honest and impartial. 
Again, the outcome is an integer in the set (0, 1,2, ... , 10,000}. The observer 
then emerges from behind the curtain and announces that the number of heads 
is at least than 7, 500. There is a pause and then someone says "What? Are you 
out of your mind?" 

So we have two probability spaces, both with sample space S = {0, 1, 2, . . . , 10, 000}. 
For each, we have a random variable X, the winning ticket number in the first situation, 
and the number of heads in the second. In each case, the expected value, £(X), of the 
random variable X is 5, 000. In the first case, we are not all that surprised at an outcome 
far from the expected value, while in the second, it seems intuitively clear that this is 
an extraordinary occurrence. The mathematical concept here is referred to as central 
tendency, and it helps us to understand just how likely a random variable is to stray 
from its expected value. 

For starters, we have the following elementary result. 

Theorem 10.20 (Markov's Inequality). Let X be a random variable in a probability space 
( S,P ). Then for every k > 0, 

P(\X\>k)<E(\X\)/k. 

Proof. Of course, the inequality holds trivially unless k > E(|X|). For k in this range, 
we establish the equivalent inequality: £P(|X| > k) < £(|X|). 

kP(\X\>k) = J]kP(\X\ = r) 

r>k 

<Y j rP{\X\ = r) 

r>k 

< rP(\X\ = r) 

r> 0 

= £( |X|). 


□ 


215 



Chapter 10 Probability 


To make Markov's inequality more concrete, we see that on the basis of this trivial 
result, the probability that either the winning lottery ticket or the number of heads 
is at least 7,500 is at most 5000/7500 = 2/3. So nothing alarming here in either case. 
Since we still feel that the two cases are quite different, a more subtle measure will be 
required. 


10.5.1 Variance and Standard Deviation 

Again, let (S, P ) be a probability space and let X be a random variable. The quantity 
E((X - £(X)) 2 ) is called the variance of X and is denoted var(X). Evidently, the vari- 
ance of X is a non-negative number. The standard deviation of X, denoted ax is then 
defined as the quantity yvar(x), i.e., a\- = var(X). 

Example 10.21. For the spinner shown at the beginning of the chapter, let X(z) = i 2 
when the pointer stops in region i. Then we have already noted that the expectation 
£(X) of the random variable X is 109/8. It follows that the variance var(X) is: 


=(108 2 + 105 2 + 100 2 + 93 2 + 84 2 )/512 
=48394/512 


109 2 1 
8 } 8 


It follows that the standard deviation ax of X is then y/48394/512 w 9.722. 

Example 10.22. Suppose that 0 < p < 1 and consider a series of n Bernoulli trials with 
the probability of success being p, and let X count the number of successes. We have 
already noted that £(X) = np. Now we claim the variance of X is given by: 

var(X) = Yj(i ~ w P) 2 (")p'( 1 “ = «P ( 1 ~ V ) 

;=o ' ' 

There are several ways to establish this claim. One way is to proceed directly from the 
definition, using the same method we used previously to obtain the expectation. But 
now you need also to calculate the second derivative. Here is a second approach, one 
that capitalizes on the fact that separate trials in a Bernoulli series are independent. 

Let T = {Xi, X 2 , . . . , X„ } be a family of random variables in a probability space 
(S, P). We say the family T is independent if for each i and j with 1 < i < j < n, 
and for each pair a, b of real numbers with 0 < a, b < 1, the following two events are 
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independent: {x e S : X,(x) < a} and {x e S : Xj(x) < b}. When the family is 
independent, it is straightforward to verify that 

var(Xi + X 2 + • ■ ■ + X„) = var(Xi) + var(X 2 ) + • • • + var(X„). 

With the aid of this observation, the calculation of the variance of the random vari- 
able X which counts the number of successes becomes a trivial calculation. But in fact, 
the entire treatment we have outlined here is just a small part of a more complex subject 
which can be treated more elegantly and ultimately much more compactly — provided 
you first develop additional background material on families of random variables. For 
this we will refer you to suitable probability and statistics texts, such as those given in 
our references. 

Proposition 10.23. Let Xbe a random variable in a probability space (S, P). Then var(X) = 
£(X 2 ) - £ 2 (X). 

Proof. Let £(X) = p. From its definition, we note that 
var(X) = ^(r - p) 2 prob(X = r) 

r 

= ^(r 2 - 2 rp + p 2 ) prob(X = r) 

r 

= ^ r 2 prob(X = r) - 2p ^ r prob(X = r) + p 2 ^ prob(X = r) 

r r r 

= £(X 2 ) - 2p 2 + p 2 
= £(X 2 ) - p 2 
= £(X 2 ) - £ 2 (X). 


□ 

Variance (and standard deviation) are quite useful tools in discussions of just how 
likely a random variable is to be near its expected value. This is reflected in the follow- 
ing theorem. 

Theorem 10.24 (Chebyshev's Inequality). Let Xbe a random variable in a probability space 
{S r P),andletk > 0 be a positive real number. If the expectation £(X) of X is p and the standard 
deviation is Ox, then 

prob(|X - £(X)| < kox) > 1 - 
Proof. Let A = {r e R : \r - p\ > kax}- 
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Then we have: 


var(X) = E((X - p) 2 ) 


= - p) 2 prob(X = r ) 


> ^(r - fi) 2 p r ob(X = r) 


> k 2 o\ ^ prob(X = r) 


> A: 2 cr|prob(|X - p\ > kox)- 


Since var(X) = cr 2 , we may now deduce that 1/k 2 > prob(|X - p\) > kox)- Therefore, 
since prob(|X - p\ < kox ) = 1 - prob(|X - p\ > kox), we conclude that 



□ 


Example 10.25. Here's an example of how Chebyshev's Inequality can be applied. 
Consider n tosses of a fair coin with X counting the number of heads. As noted before, 
p = E(X ) = n/2 and var(X) = n/ 4, so Ox = yfn/2. When n = 10,000 and p = 5,000 
and ox = 50. Setting k = 50 so that kox = 2500, we see that the probability that X is 
within 2500 of the expected value of 5000 is at least 0.9996. So it seems very unlikely 
indeed that the number of heads is at least 7, 500. 

Going back to lottery tickets, if we make the rational assumption that all ticket num- 
bers are equally likely, then the probability that the winning number is at least 7, 500 
is exactly 2501/100001, which is very close to 1/4. 

Example 10.26. In the case of Bernoulli trials, we can use basic properties of binomial 
coefficients to make even more accurate estimates. Clearly, in the case of coin tossing, 
the probability that the number of heads in 10, 000 tosses is at least 7, 500 is given by 



Now a computer algebra system can make this calculation exactly, and you are encour- 
aged to check it out just to see how truly small this quantity actually is. 
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10.6 Probability Spaces with Infinitely Many Outcomes 

To this point, we have focused entirely on probability spaces (S,P) with S a finite set. 
More generally, probability spaces are defined where S is an infinite set. When S is 
countably infinite, we can still define P on the members of S, and now YjxzS P( x ) is an 
infinite sum which converges absolutely (since all terms are non-negative) to 1 . When 
S is uncountable, P is not defined on S. Instead, the probability function is defined on 
a family of subsets of S. Given our emphasis on finite sets and combinatorics, we will 
discuss the first case briefly and refer students to texts that focus on general concepts 
from probability and statistics for the second. 

Example 10.27. Consider the following game. Nancy rolls a single die. She wins if 
she rolls a six. If she rolls any other number, she then rolls again and again until the 
first time that one of the following two situations occurs: (1) she rolls a six, which now 
this results in a loss or (2) she rolls the same number as she got on her first roll, which 
results in a win. As an example, here are some sequences of rolls that this game might 
take: 

1. (4, 2,3, 5, 1, 1, 1,4). Nancy wins! 

2. (6). Nancy wins! 

3. (5, 2, 3, 2, 1, 6). Nancy loses. Ouch. 

So what is the probability that Nancy will win this game? 

Nancy can win with a six on the first roll. That has probability 1/6. Then she might 
win on round n where n >2. To accomplish this, she has a 5/6 chance of rolling a 
number other than six on the first roll; a 4/6 chance of rolling something that avoids a 
win/ loss decision on each of the rolls, 2 through n - 1 and then a 1/6 chance of rolling 
the matching number on round n . So the probability of a win is given by: 

1 y, 5 /4\"“ 2 1 _ 7 
6 + 2j616/ 6 “ 12‘ 

n> 2 

Example 10.28. You might think that something slightly more general is lurking in the 
background of the preceding example — and it is. Suppose we have two disjoint events 
A and B in a probability space (S, P) and that P(A ) + P(B ) < 1. Then suppose we make 
repeated samples from this space with each sample independent of all previous ones. 
Call it a win if event A holds and a loss if event B holds. Otherwise, it's a tie and we 
sample again. Now the probability of a win is: 

F(A) + P(A) 2<1 -FW- P(B»” = ■ 
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10.7 Discussion 

Bob was late for morning coffee and the group was well into dissecting today's applied 
combinatorics class. As he approached the table, he blurted out "Ok guys, here's a 
problem that doesn't make any sense to me, except that Nadja, my friend from biology, 
says that if I have a good feel for probability, then it is transparent." Alice not very 
softly interjected "Not much goes through six inches of iron." Bob didn't bite "A guy 
eats lunch at the same diner every day. After lunch, the waiter asks if he wants dessert. 
He asks for the choices and the waiter replies 'We have three kinds of pie: apple, cherry 
and pecan.' Then the guy always says 'I'll have pecan pie.' This goes on for six months. 
Then one day, the waiter says 'I have bad news. Today, we don't have any apple pie, so 
your only choices are cherry and pecan.' Now the guy says 'In this case. I'll have the 
cherry pie.' I have to tell you all that this doesn't make any sense to me. Why would 
the guy ask for cherry pie in preference to pecan pie when he consistently takes pecan 
pie over both cherry pie and apple pie?" 

Zori was the first to say something "Ok guys, I've finally willing to accept the premise 
that big integer arithmetic, and things that reflect the same flavor, might and I empha- 
size might, have some relevance in the real world, but this conversation about dessert 
in some stupid diner is too much." Xing was hesitant but still offered "There's some- 
thing here. That much I'm sure." Dave said "Yeah, a great dessert. Especially the 
pecan pie." Alice was not amused. All the while Carlos was thinking. Finally, he said 
"I think it has something to do with conditional probability. The patron's preference 
for pecan pie was conditioned on the fact that there were three choices. When there 
were only two choices, his preferences changed." 

Now Yolanda saw more "Doesn't this happen all the time in presidential politics? 
People prefer candidate A when A, B and C are running, but when candidate C drops 
out, they shift their preference to candidate B." Alice said "You could say the same 
thing about close personal relationships." Although she didn't say it, she was thinking 
that it wouldn't matter how many dropped out if Bob was one of the remaining. 


10.8 Exercises 

1. Our gang of seven (Alice, Bob, Carlos, Dave, Xing, Yolanda and Zori) are students 
in a class with a total enrollment of 35. The professor chooses three students at random 
to go to the board to work challenge problems. 

(a) What is the probability that Yolanda is chosen? 

(b) What is the probability that Yolanda is chosen and Zori is not? 

(c) What is the probability that exactly two members of the club are chosen? 
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(d) What is the probability that none of the seven members of club are chosen? 

2 . Bob says to no one in particular, "Did you know that the probability that you will 
get at least one '7' in three rolls of a pair of dice is slightly less than 1/2. On the other 
hand, the probability that you'll get at least one '5' in six rolls of the dice is just over 
1 /2." Is Bob on target, or out to lunch? 

3. Consider the spinner shown in Figure 10.1 at the beginning of the chapter. 

(a) What is the probability of getting at least one "5" in three spins? 

(b) What is the probability of getting at least one “3" in three spins? 

(c) If you keep spinning until you get either a "2" or a "5", what is the probability 
that you get a "2" first? 

(d) If you receive i dollars when the spinner halts in region i, what is the expected 
value? Since three is right in the middle of the possible outcomes, is it reasonable 
to pay three dollars to play this game? 

4. Alice proposes to Bob the following game. Bob pays one dollar to play. Fifty balls 
marked 1, 2, . . . , 50 are placed in a big jar, stirred around, and then drawn out one by 
one by Zori, who is wearing a blindfold. The result is a random permutation a of 
the integers 1,2,..., 50. Bob wins with a payout of two dollars and fifty cents if the 
permutation a is a derangement, i.e., a{i) + i for all z = 1,2, ... ,n. Is this a fair game 
for Bob? If not how should the payoff be adjusted to make it fair? 

5. A random graph with vertex set {1,2,..., 10} is constructed using the following 
method. For each two element subset {/,/} from {1,2, ... , 10}, a fair coin is tossed 
and the edge {i, j } then belongs to the graph when the result is "heads." For each 3- 
element subset S c {1,2, . . . , n }, let Eg be the event that S is a complete subgraph in 
our random graph. 

(a) Explain why P(Ej) = 1/8 for each 3-element subset S. 

(b) Explain why Eg and Ej are independent when |S fl T| < 1. 

(c) Lets = {1,2,3}, T = {2,3,4} and U = {3,4,5}. Show that 

P(E s |E r ) = P(E s |E T Eu). 


6. Ten marbles labeled 1, 2, . . . , 10 are placed in a big jar and then stirred up. Zori, 
wearing a blindfold, pulls them out of the jar two at a time. Players are allowed to place 
bets as to whether the sum of the two marbles in a pair is 11. There are C(10,2) = 45 
different pairs and exactly 5 of these pairs sums to eleven. 
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Suppose Zori draws out a pair; the results are observed; then she returns the two balls 
to the jar and all ten balls are stirred before the next sample is taken. Since the proba- 
bility that the sum is an "11" is 5/45 = 1/9, then it would be fair to pay one dollar to 
play the game if the payoff for an "11" is nine dollars. Similarly, the payoff for a wager 
of one hundred dollars should be nine hundred dollars. 

Now consider an alternative way to play the game. Now Zori draws out a pair; the 
results are observed; and the marbles are set aside. Next, she draws another pair from 
the remaining eight marbles, followed by a pair selected from the remaining six, etc. 
Finally, the fifth pair is just the pair that remains after the fourth pair has been selected. 
Now players may be free to wager on the outcome of any or all or just some of the 
five rounds. Explain why either everyone should or no one should wager on the fifth 
round. Accordingly, the last round is skipped and all marbles are returned to the jar 
and we start over again. 

Also explain why an observant player can make lots of money with a payout ratio of 
nine to one. Now for a more challenging problem, what is the minimum payout ratio 
above which a player has a winning strategy? 
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CHAPTER 


Applying Probability to 
Combinatorics 

11.1 A First Taste of Ramsey Theory 

Bob likes to think of himself as a wild and crazy guy, totally unpredictable. Most 
guys do. But Alice says that Bob can't change his basic nature, which is excruciatingly 
boring. Carlos remarks that perhaps we shouldn't be so hard on Bob, because under 
certain circumstances, we can all be forced to be dull and repetitive. 

Recall that when n is a positive integer, we let [n] = {1,2 , ,n}. In this chapter, 
when X is a set and A: is a non-negative integer with k < |X|, we borrow from our in- 
line notation for binomial coefficients and let C(X, k) denote the family of all /(-element 
subsets of X. So |C([n],k)| = C{n, k) whenever 0 <k < n. 

Recall that the Pigeon Hole Principle asserts that if n + 1 pigeons are placed in n 
holes, then there must be some hole into which two or more pigeons have been placed. 
More formally, if n and k are positive integers, f > n(k - 1) and / : [f] — * [n] is 
any function, then there is a /c-element subset H C [ f | and an element j e [n | so that 
f(i ) = j for every i e H. 

We now embark on a study of an elegant extension of this basic result, one that 
continues to fascinate and challenge. 

Returning to the discussion at the start of this section, you might say that an induced 
subgraph H of a graph G is "boring" if it is either a complete subgraph or an indepen- 
dent set. In either case, exactly every pair of vertices in H behaves in exactly the same 
boring way. So is boredom inevitable? The answer is yes — at least in a relative sense. 
As a starter, let's show that any graph on six (or more) vertices has a boring subgraph 
of size three. 

Lemma 11.1. Let G be any graph with six of more vertices. Then either G contains a complete 
subgraph of size 3 or an independent set of size 3. 

Proof. Let x be any vertex in G. Then split the remaining vertices into two sets Si and 
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S 2 with Si being the neighbors of x and S 2 the non-neighbors. Since G has at least six 
vertices, we know that either |Si| > 3 or IS 2 I > 3. Suppose first that |Si| > 3 and let 
i/i, r /2 and 1/3 be distinct vertices from Si. If gig j is an edge in G for some distinct pair 
i, j e {1, 23}, then \ x , 1 / , , 1 / , } is a complete subgraph of size 3 in G. On the other hand, 
if there are no edges among the vertices in { 1 / 1 , 1 / 2 , 1 / 3 }, then we have an independent 
set of size 3. 

The argument when IS 2 I > 3 is dual. □ 

We note that the bound of six in the preceding lemma is sharp, as a cycle on five 
vertices does not contain either a complete set of size 3 nor an independent set of size 3. 
Next, here is the statement that generalizes this result. 

Theorem 11.2 (Ramsey's Theorem for Graphs). Ifm and n are positive integers, then there 
exists a least positive integer R(m, n)so that ifG is a graph and G has at least R(m, n) vertices, 
then either G contains a complete subgraph on m vertices, or G contains an independent set of 
size n. 

Proof. We show that R(m, n) exists and is at most ( m ^"} 2 ). This claim is trivial when 
either m < 2 or n < 2, so we may assume that m,n > 3. From this point, we proceed 
by induction ont = m+n assuming that the result holds when t < 5. 

Now let x be any vertex in G. Then there are at least ('"f'lf 2 ) - 1 other vertices, which 
we partition as Si U S 2 , where Si are those vertices adjacent to x in G and S 2 are those 
vertices which are not adjacent to s . 

We recall that the binomial coefficients satisfy 

Im + n - 2\ Im + n - 3\ Im + n - 3\ Im + n — 3\ Im+n — 3\ 

\ m — 1 / \ m — 2 ) \ m — 1 / \ m — 2 J \ n — 2 J 

So either |Si | > (' n ^!fi) or |Si | > If the first option holds, and Si does not have 

an independent set of size n, then it contains a complete subgraph of size m — 1. It 

follows that we may add x to this set to obtain a complete subgraph of size m in G. 

Similarly, if the second option holds, and S 2 does not contain a complete subgraph 
of size m, then S 2 contains an independent set of size n — 1 , and we may add x to this 
set to obtain an independent set of size n in G. □ 

11.2 Small Ramsey Numbers 

Actually determining the Ramsey numbers R(m, n) referenced in Theorem 11.2 seems 
to be a notoriously difficult problem, and only a handful of these values are known 
precisely. In particular, R(3, 3) = 6 and R(4, 4) = 18, while 43 < R(5, 5) < 49. The 
distinguished Hungarian mathematician Paul Erdos said on many occasions that it 
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might be possible to determine R( 5, 5) exactly, if all the world's mathematical talent 
were to be focused on the problem. But he also said that finding the exact value of 
R( 6, 6) might be beyond our collective abilities. 

In the following table, we provide information about the Ramsey numbers R(m, n) 
when m and n are at least 3 and at most 9. When a cell contains a single number, that 
is the precise answer. When there are two numbers, they represent lower and upper 
bounds. 


m 

m 3 4 

5 

6 

7 

8 

9 

3 

6 9 

14 

18 

23 

36 

39 

4 

18 

25 

36, 41 

49,61 

58,84 

73, 115 

5 


43,49 

58, 87 

80, 143 

101,216 

126,316 

6 



102, 165 

113, 298 

127, 495 

169, 780 

7 




205, 540 

217, 1031 

241, 1713 

8 





282, 1870 

317, 3583 

9 






565, 6588 


Table 11.3: Small Ramsey numbers R(m, n ) 

For additional (or more current) data, see Dynamic Survey #DS1: "Small Ramsey 
Numbers" by Stanislaw Radziszowski in the Electronic Journal of Combinatorics. (Ta- 
ble 11.3 was last updated using the 12 January 2014 version of that article.) 
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We will find it convenient to utilize the following approximation due to Stirling. You 
can find a proof in almost any advanced calculus book. 


n! ~ y/lnn 



1 

288?i 2 


139 

51840;i 3 



Of course, we will normally be satisfied with the first term: 


n! ~ A Jinn 



n 


Using Stirling's approximation and the binomial coefficients from the proof of Ram- 
sey's Theorem for Graphs, we have the following upper bound: 


R(n,n) < 


2n -2 
71-1 


22 n 

Ay/nn 
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11.4 Applying Probability to Ramsey Theory 

The following theorem, due to P. Erdos, is a true classic, and is presented here in a 
manner that is faithful to how it was first published. As we shall see later, it was sub- 
sequently recast — but that's getting the cart ahead of the horse. 

Theorem 11.4. Ifn is a positive integer. Then 

R(n,n) > —2^ n 

eV2 

Proof. Let t be an integer with t > n and consider the set F of all labeled graphs with 
vertex set {1,2, ... ,t}. Clearly, there are 2 C<,/2 ) graphs in this family. Let F\ denote the 
subfamily consisting of those graphs which contain a complete subgraph of size n . It 
is easy to see that 

\F\\ < ^2 n ^~ n ^2 c ^~ n,2 \ 

Similarly, let Fi denote the subfamily consisting of those graphs which contain an in- 
dependent set of size n . It follows that 


\Fi\ < '^2 n(t ~ n ' , 2 c(t ~ n ' 2 \ 

We want to take the integer t as large as we can while still guaranteeing that \F\ | + 
\Ft\ < m This will imply that there is a graph G in F which does not contain a 
complete subgraph of size n or an independent set of size n . So consider the following 
inequality: 

2 1 ^ j 2 H P~n Q ' f ~"' 2 ) < 2 c< - t ’ 2 f (11.4.1) 

Now we ask how large can t be without violating inequality (11.4.1)? To answer this, 
we use the trivial inequality ( n ) < t" 
n ! . After some algebra and taking the 
guarantee that 

t 

□ 


/n! and the use the Stirling approximation for 
n lh root of both sides, we see that we need only 


eyfn 


226 


11.5 Ramsey's Theorem 


Now let's take a second look at the proof of Theorem 11.4. We consider a probability 
space (S, P) where the outcomes are graphs with vertex set {1, 2, . . . , t }. For each i and 
j with 1 < i < j < t, edge ij is present in the graph with probability 1 /2. Furthermore, 
the events for distinct pairs are independent. 

Let Xi denote the random variable which counts the number of n -element subsets of 
{1, 2, . . . , f} for which all (j) pairs are edges in the graph. Similarly, X 2 is the random 
variable which counts the number of n -element independent subsets of {1,2 , ,t}. 
Then set X = Xi + X 2 . 

By linearity of expectation, £(X) = £(X 1 ) + £(X 2 ) while 

e(X! ) = e(x 2 ) = (')_L_ 

If E(X) < 1, then there must exist a graph with vertex set {1,2 , ... ,t} without a K n 
or an I n . And the question of how large t can be while maintaining E(X) < 1 leads to 
exactly the same calculation we had before. 

After more than fifty years and the efforts of many very bright researchers, only 
marginal improvements have been made on the bounds on R(n, n ) from Theorem 11.2 
and Theorem 11.4. In particular, no one can settle whether there is some constant c <2 
and an integer no so that R(n,n) < 2 cn when n > no- Similarly, no one has been able to 
answer whether there is some constant d > 1/2 and an integer n\ so that R(n , n ) > 2 dn 
when n > n 1 . We would certainly give you an A for this course if you managed to do 
either. 

Discussion 11.5. Carlos said that he had been trying to prove a good lower bound 
on R(n,n) using only constructive methods, i.e., no random techniques allowed. But 
he was having problems. Anything he tried seemed only to show that R{n,n) > n c 
where c is a constant. That seems so weak compared to the exponential bound which 
the probabilistic method gives easily. Usually Alice was not very sympathetic to the 
complaints of others and certainly not from Carlos, who seemed always to be out front. 
But this time, Alice said to Carlos and in a manner that all could hear "Maybe you 
shouldn't be so hard on yourself. I read an article on the web that nobody has been 
able to show that there is a constant c > 1 and an integer Hq so that R(n, n ) > c" when 
n > no, provided that only constructive methods are allowed. And maybe, just maybe, 
saying that you are unable to do something that lots of other famous people seem also 
unable to do is not so bad." Bob saw a new side of Alice and this too wasn't all bad. 


11.5 Ramsey’s Theorem 

By this time, you are probably not surprised to see that there is a very general form of 
Ramsey's theorem. We have a bounded number of bins or colors and we are placing 
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the subsets of a fixed size into these categories. The conclusion is that there is a large 
set which is treated uniformly. 

Here's the formal statement. 

Theorem 11.6. Let r and s be positive integers and let h = . . . ,h r ) be a string of 

integers with hi > s for each i = 1,2 , ... ,s. Then there exists a least positive integer R(s : 
h\,li 2 , . . . , h r ) so that if n > no and (p : C([n],s] — » [r] is any function, then there exists 
an integer a e [r] and a subset H a c [n] with \H a \ = h a so that cp(S) = a for every 
S e C(H a ,s). 

We don't include the proof of this general statement here, but the more ambitious 
students may attempt it on their own. Note that the case s = 1 is just the Pigeon Hole 
Principle, while the case s = r = 2 is just Ramsey's Theorem for Graphs. An argument 
using double induction is required for the proof in the general case. The first induction 
is on r and the second is on s . 


11.6 The Probabilistic Method 

At the outset of this chapter, we presented Erdos' original proof for the lower bound for 
the Ramsey number R(n, n) using counting. Later, we recast the proof in a probabilistic 
setting. History has shown that this second perspective is the right one. To illustrate 
the power of this approach, we present a classic theorem, which is also due to Erdos, 
showing that there are graphs with large girth and large chromatic number. 

The girth g of a graph G is the smallest integer for which G contains a cycle on g 
vertices. The girth of a forest is taken to be infinite, while the girth of a graph is three if 
and only if it has a triangle. You can check the families of triangle-free, large chromatic 
number, graphs constructed in Chapter 5 and see that each has girth four. 

Theorem 11.7 (Erdos). For every pair g, t of integers with g > 3, there exists a graph G with 
y(G) > t and the girth ofG greater than g. 

Proof. Before proceeding with the details of the argument, let's pause to get the general 
idea behind the proof. We choose integers n and s with n > s, and it will eventually 
be clear how large they need to be in terms of g and t . We will then consider a random 
graph on vertex set {1,2, ... ,n}, and just as before, for each i and j with 1 < i < j < n, 
the probability that the pair i j is an edge is p, but now p will depend on n . Of course, 
the probability that any given pair is an edge is completely independent of all other 
pairs. 

Our first goal is to choose the values of n, s and p so that with high probability, a 
random graph does not have an independent set of size s . You might think as a second 
goal, we would try to get a random graph without small cycles. But this goal is too 
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restrictive. Instead, we just try to get a graph in which there are relatively few small 
cycles. In fact, we want the number of small cycles to be less than n/ 2. Then we will 
remove one vertex from each small cycles, resulting in a graph with at least n/2 vertices, 
having no small cycles and no independent set of size s . The chromatic number of this 
graph is at least n /2s, so we will want to have the inequality n > 1st. 

Now for some details. Let X\ be the random variable that counts the number of 
s -element independent sets. Then 

E(XO = (g)(l - P) C(S ' 2) 

Now we want £(Xi) < 1/4. Since C(n,s) < n s = e s]nn and (1 - p) c b' 2 ) < e -ps 2 / 2 , it 
suffices to set s = 2 In n jp. By Markov's Inequality, the probability that X\ exceeds 
1/2 > 2£(Xi) is less than 1/2. 

Now let X 2 count the number of cycles in G of size at most g . Then 


9 

£(X 2 ) < ^ n(n - 1 )(« — 2) ...(« — i + l)p ! < g(pn) 9 . 

i = 3 

Now, we want £(X 2 ) < n/ 4, and an easy calculation shows that g(np ) 9 < n/ 4 when 
p = / ] () Again by Markov's Inequality, the probability that X 2 exceeds n/2 > 

2 £(X 2 ) is less than 1/2. 

We conclude that there is a graph G for which X\ = 0 and X 2 < n/2. Remove a 
vertex from each of the small cycles in G and let H be the graph that remains. Clearly, 
H has at least n /2 vertices, no cycle of size at most g and no independent set of size s . 
Finally, the inequality n > 2s f requires n 1 ^ /{ 40 In n) > t. □ 

11.6.1 Gaining Intuition with the Probabilistic Method 

Experienced researchers are able to simplify the calculations in an argument of this 

type, as they know what can safely be discarded and what can not. Here's a quick 

2 

tour of the essential steps. We want £(Xi) to be small, so we set n s e~ ps = 1 and get 
s = In n jp. We want the number of small cycles to be about n so we set (gp)‘ J = n and 

get p = /i b 1 / 1 . Finally, we want n = st which requires n l/9 = f . The rest is just paying 

attention to details. 


11.7 Discussion 

Zori started the conversation with "Who in their right mind would trust their lives to an 
algorithm that used random methods?" Xing quickly responded "Everyone. At least 
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everyone should. We routinely deal with probabilistic concepts, like getting run over 
by a bus when crossing the street or having a piano fall on our head. The general public 
is much more comfortable with notions of probability, even though they may never 
know the formal definition of a probability space. I for one am completely comfortable 
taking an airline flight if I can be assured that the probability of a disaster is less than 

hr 20 ." 

Dave wasn't biting on this topic. Instead he offered "You have to be struck by the 
statements that it appears difficult to construct objects which you can prove exist in 
abundance. I wonder why this is so." Alice said "We all find your brain to be a totally 
random thing, sometimes making sense but often not." There was laughter or at least 
some snickering. But after a bit, Carlos said "There's something fundamental here. 
Maybe one could prove that there are easily stated theorems which only have long 
proofs." Bob blurted "That doens't make any sense." Zori saw an opportunity where 
a client would, at considerable expense, commission her to solve a problem (at least 
better than the competition) that was readily understood but somehow difficult in the 
end. She knew about the class NV but maybe there were even bigger challenges (and 
bigger paychecks) out there. 


11.8 Exercises 

1. Consider a random graph with vertex set {1,2, jn}. If the edge probability is p — 
1 /2, then let X denote the number of complete subgraphs of size t = 2 log n and let Y 
denote the number of independent sets of size t = 2 log n . 

(a) Show that E(X + Y) < 1, when n is sufficiently large. 

(b) Use the result from part a to show that a>(G) is less than 2 log n, while the chro- 
matic number of G is at least n /(2 log n) (both statements holding with high prob- 
ability). As a result, the basic inequality y(C) > co(G) is far from being tight for a 
random graph. 

2. We form a random tournament as follows. Start with a complete graph with vertex 
set {1,2 For each distinct pair i, j with 1 </</<«, flip a fair coin. If the 
result is heads, orient the edge from i to j, which we denote by (x , y). If the toss is tails, 
then the edge is oriented from j to i, denoted (y, x). Show that when n is large, with 
high probability, the following statement is true: For every set S of size log n /10, there 
is a vertex x so that (x , y) in T for every y e S. 

3. Let T be a random tournament on n vertices. Show that with high probability, the 
following statement is true: For every pair x, y of distinct vertices, either (1) (x, y) in 
T, or (2) there is a vertex z for which both (x, z ) and (z, y) are in T. 
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4. Many statements for random graphs exhibit a threshold behavior. Show that a 
random graph with edge probability p = 10 log n/n almost certainly has no isolated 
vertices, while a random graph with edge probability p = log n/(10n) almost certainly 
has at least one isolated vertices. 

5. In the sense of the preceding problem, determine the threshold probability for a 
graph to be connected. 
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CHAPTER 


Graph Algorithms 

In previous chapters, we have encountered a few algorithms for problems involving 
discrete structures such as finding euler circuits (Chapter 5) or partitioning a poset into 
antichains (Chapter 6). This chapter begins a sequence of three chapters that focus on 
algorithms. In this chapter we explore two minimization problems for graphs in which 
we assign a weight to each edge of the graph. The first problem studied is determining 
a spanning tree of minimum weight. The second is of finding shortest paths from a 
root vertex to each other vertex in a directed graph. 


12.1 Minimum Weight Spanning Trees 


In this section, we consider pairs (G, zv) where G = ( V , E) is a connected graph and 
iv : E — > No- For each edge e e E, the quantity w(e) is called the weight of e. Given a 
set S of edges, we define the weight of S, denoted w(S), by setting w(S) = £ eeS w(e). 
In particular, the weight of a spanning tree T is just the sum of the weights of the edges 
inT. 

Weighted graphs arise in many contexts. One of the most natural is when the weights 
on the edges are distances or costs. For example, consider the weighted graph in Fig- 
ure 12.1. Suppose the vertices represent nodes of a network and the edges represent 
the ability to establish direct physical connections between those nodes. The weights 
associated to the edges represent the cost (let's say in thousands of dollars) of building 
those connections. The company establishing the network among the nodes only cares 
that there is a way to get data between each pair of nodes. Any additional links would 
create redundancy in which they are not interested at this time. A spanning tree of 
the graph ensures that each node can communicate with each of the others and has 
no redundancy, since removing any edge disconnects it. Thus, to minimize the cost of 
building the network, we want to find a minimum weight (or cost) spanning tree. 
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c 



Figure 12.1: A weighted graph 

To do this, this section considers the following problem: 

Problem 12.2. Find a minimum weight spanning tree T of G. 

To solve this problem, we will develop two efficient graph algorithms, each hav- 
ing certain computational advantages and disadvantages. Before developing the algo- 
rithms, we need to establish some preliminaries about spanning trees and forests. 

12.1.1 Preliminaries 

The following proposition about the number of components in a spanning forest of a 
graph G has an easy inductive proof. You are asked to provide it in the exercises. 

Proposition 12.3. Let G = (V, E) be a graph on n vertices, and let H = (V, S ) be a spanning 
forest. Then 0 < |S| < n - 1. Furthermore, if\S\ = n — k, then H has k components. In 
particular, H is a spanning tree if and only if it contains n — 1 edges. 

The following proposition establishes a way to take a spanning tree of a graph, re- 
move an edge from it, and add an edge of the graph that is not in the spanning tree to 
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create a new spanning tree. Effectively, the process exchanges two edges to form the 
new spanning tree, so we call this the exchange principle. 

Proposition 12.4 (Exchange Principle). Let T = (V, S) be spanning tree in a graph G, and 
let e = xy be an edge of G which does not belong to T. Then 

1. There is a unique path P = (xo,*i,* 2 , • • • , *t) with (a) x = xq; (b) y = x t ; and 
(c) XiXi+i e S for each i = 0,1,2, . . . , f - 1. 

2. For each i = 0, 1,2, . . . , t - 1, let f = x,x, + i and then set 

S; — {e} U {y e S : g + /;}, 

i.e., we exchange edge fifor edge e. Then T,- = (V, S,) is a spanning tree of G. 

Proof. For the first fact, it suffices to note that if there were more than one distinct path 
from x to y in T, we would be able to find a cycle in T. This is impossible since it is a 
tree. For the second, we refer to Figure 12.5. The black and green edges in the graph 
shown at the left represent the spanning tree T. Thus, / lies on the unique path from 
x to y in T and e = xy is an edge of G not in T. Adding e to T creates a graph with 
a unique cycle, since T had a unique path from x to y. Removing / (which could be 
any edge /, of the path, as stated in the proposition) destroys this cycle. Thus T, is a 
connected acyclic subgraph of G with n - 1 + 1 — 1 = n - 1 edges, so it is a spanning 
tree. 



□ 

For both of the algorithms we develop, the argument to show that the algorithm is 
optimal rests on the following technical lemma. To avoid trivialities, we assume n > 3. 
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Lemma 12.6. Let ¥bea spanning forest of G and let Che a component of F. Also, let e = xy 
he an edge of minimum iveight among all edges with one endpoint in C and the other not in C. 
Then among all spanning trees of G that contain the forest F, there is one of minimum iveight 
that contains the edge e. 

Proof. Let T = (V, S) be any spanning tree of minimum weight among all spanning 
trees that contain the forest F, and suppose that e = xy is not an edge in T. (If it were 
an edge in T, we would be done.) Then let P = (xq, X\ , Xi, . . . , x t ) be the unique path 
in T with (a) x = xo; (b) y = x t ; and (c) x,x; + i e S for each i = 0 , 1 , 2 , ... ,t — 1 . Without 
loss of generality, we may assume that x = xo is a vertex in C while y = Xt does not 
belong to C. Then there is a least non-negative integer i for which x, is in C and x ;+ \ is 
not in C. It follows that x; is in C for all j with 0 <j< i- 

Let / = XiXi+i. The edge e has minimum weight among all edges with one endpoint 
in C and the other not in C, so zv(e) < w(f ). Now let T, be the tree obtained by ex- 
changing the edge / for edge e. It follows that iv(Tj) = z«(T) - iv(f) + iv(e) < w(T). 
Furthermore, T, contains the spanning forest F as well as the edge e. It is therefore the 
minimum weight spanning tree we seek. □ 

Discussion 12.7. Although Bob's combinatorial intuition has improved over the course 
he doesn't quite understand why we need special algorithms to find minimum weight 
spanning trees. He figures there can't be that many spanning trees, so he wants to just 
write them down. Alice groans as she senses that Bob must have been absent when 
the material from Section 5.6 was discussed. In that section, we learned that a graph 
on n vertices can have as many as n"~ 2 spanning trees (or horrors, the instructor may 
have left it off the syllabus). Regardless, this exhaustive approach is already unus- 
able when n = 20. Dave mumbles something about being greedy and just adding the 
lightest edges one-by-one while never adding an edge that would make a cycle. Zori 
remembers a strategy like this working for finding the height of a poset, but she's wor- 
ried about the nightmare situation that we learned about with using FirstFit to color 
graphs. Alice agrees that greedy algorithms have an inconsistent track record but sug- 
gests that Lemma 12.6 may be enough to get one to succeed here. 

12.1.2 Kruskal’s Algorithm 

In this section, we develop one of the best known algorithms for finding a minimum 
weight spanning tree. It is known as Kruskal's Algorithm, although some prefer the 
descriptive label Avoid Cycles because of the way it builds the spanning tree. 

To start Kruskal's algorithm, we sort the edges according to weight. To be more 
precise, let m denote the number of edges in G = (V, E ) . Then label the edges as 
D/ £ 2 /^ 3 , ... ,e m so that zc(ei) < w(ef) < ■■■ < w(e m ). Any of the many available 
efficient sorting algorithms can be used to do this step. 
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Once the edges are sorted, Kruskal's algorithm proceeds to an initialization step and 
then inductively builds the spanning tree T = ( V , S): 

Algorithm 12.8 (Kruskal's Algorithm). 

Initialization. Set S = 0 and i = 0. 

Inductive Step. While |S| < n - 1, let j be the least non-negative integer so that j > i and 
there are no cycles in S U { ey } . Then (using pseudo-code) set 

i = j and S = S U {j}. 

The correctness of Kruskal's Algorithm follows from an inductive argument. First, 
the set S is initialized as the empty set, so there is certainly a minimum weight spanning 
tree containing all the edges in S. Now suppose that for some i with 0 < i < n, |S| = i 
and there is a minimum weight spanning tree containing all the edges in S . Let F be the 
spanning forest determined by the edges in S, and let Ci, C 2 , . . . , C s be the components 
of F. For each k = 1, 2, . . . , s, let fk be a minimum weight edge with one endpoint in 
Ck and the other not in C/ c . Then the edge e added to S by Kruskal's Algorithm is 
just the edge {/ 1 , fi, ■ ■ ■ , fs} having minimum weight. Applying Lemma 12.6 and the 
inductive hypothesis, we know that there will still be a minimum weight spanning tree 
of G containing all the edges of S U {e}. 

Example 12.9 (Kruskal's Algorithm). 

Let's see what Kruskal's algorithm does on the weighted graph in c k 23 

Figure 12.1. It first sorts all of the edges by weight. We won't repro- a g 25 

duce the list here, since we won't need all of it. The edge of least f g 26 

weight is ck, which has weight 23. It continues adding the edge of f i 29 

least weight, adding ay, fy, fi, fj, and bj. Flowever, after doing f j 30 

this, the edge of lowest weight is fb, which has weight 38. This b j 34 

edge cannot be added, as doing so would make fjb a cycle. Thus, b c 39 

the algorithm bypasses it and adds be. Edge ai is next inspected, e m 49 

but it, too, would create a cycle and is eliminated from considera- d l 55 

tion. Then em is added, followed by dl. There are now two edges d j 56 

of weight 56 to be considered: al and dj . Our sorting algorithm e k 59 

has somehow decided one of them should appear first, so let's say c h 79 

it's dj. After adding dj, we cannot add al, as ayfjdl would form a 
cycle. Edge dk is next considered, but it would also form a cycle. 

Flowever, ek can be added. Edges km and dm are then bypassed. 

Finally, edge ch is added as the twelfth and final edge for this 13- 
vertex spanning tree. The full list of edges added (in order) is shown 
to the right. The total weight of this spanning tree is 504. 
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12.1.3 Prim’s Algorithm 

We now develop Prim's Algorithm for finding a minimum weight spanning tree. This 
algorithm is also known by a more descriptive label: Build Tree. We begin by choosing 
a root vertex r. Again, the algorithm proceeds with an initialization step followed by 
a series of inductive steps. 

Algorithm 12.10 (Prim's Algorithm). 

Initialization. Set W = {r} and S = 0. 

Inductive Step. While |W| < n, let e he an edge of minimum weight among all edges with 
one endpoint in W and the other not in W. If e = xy, x e W and y £ W , update W 
and S by setting (using pseudo-code) 

W = W U {y} and S = S U {e}. 

The correctness of Prim's algorithm follows immediately from Lemma 12.6. 
Example 12.11 (Prim's Algorithm). 

Let's see what Prim's algorithm does on the weighted graph in Fig- a g 25 

ure 12.1. We start with vertex a as the root vertex. The lightest edge f g 26 

connecting a (the only vertex in the tree so far) to the rest of the f i 29 

graph is ay. Next, f g is added. This is followed by fi, fj, bj, and f j 30 

be. Next, the algorithm identifies ck as the lightest edge connecting b j 34 

{a, g , i, /, j , b, c} to the remaining vertices. Notice that this is con- b c 39 

siderably later than Kruskal's algorithm finds the same edge. The c k 23 

algorithm then determines that al and jd, both of weight 56 are the a l 56 

lightestedgesconnectingverticesinthetreetotheothervertices.lt d l 55 
picks arbitrarily, so let's say it takes al. It next finds dl, then ek, and e k 59 
then em. The final edge added is cli. The full list of edges added (in e m 49 

order) is shown to the right. The total weight of this spanning tree c h 7 9 

is 504. This (not surprisingly) the same weight we obtained using 
Kruskal's algorithm. However, notice that the spanning tree found 
is different, as this one contains a 1 instead of dj. This is not an issue, 
of course, since in both cases an arbitrary choice between two edges 
of equal weight was made. 

12.1.4 Comments on Efficiency 

An implementation of Kruskal's algorithm seems to require that the edges be sorted. 
If the graph has n vertices and m edges, this requires m log m operations just for the 
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sort. But once the sort is done, the process takes only n — 1 steps — provided you keep 
track of the components as the spanning forest expands. Regardless, it is easy to see 
that at most 0(n 2 log n ) operations are required. 

On the other hand, an implementation of Prim's algorithm requires the program to 
conveniently keep track of the edges incident with each vertex and always be able to 
identify the edge with least weight among subsets of these edges. In computer science, 
the data structure that enables this task to be carried out is called a heap. 


12.2 Digraphs 

In this section, we introduce another useful variant of a graph. In a graph, the existence 
of an edge xy can be used to model a connection between x and y that goes in both 
ways. However, sometimes such a model is insufficient. For instance, perhaps it is 
possible to fly from Atlanta directly to Fargo but not possible to fly from Fargo directly 
to Atlanta. In a graph representing the airline network, an edge between Atlanta and 
Fargo would lose the information that the flights only operate in one direction. To deal 
with this problem, we introduce a new discrete structure. A digraph G is a pair ( V , E ) 
where V is a vertex set and £ c V xV with x + y for every (x, y) e E. We consider the 
pair (x, y ) as a directed edge from x to y. Note that for distinct vertices x and y from 
V , the ordered pairs (x, y) and (y, x) are distinct, so the digraph may have one, both 
or neither of the directed edges (x, y) and (y, x). This is in contrast to graphs, where 
edges are sets, so {x, y} and {y, x} are the same. 

Diagrams of digraphs use arrowheads on the edges to indicate direction. This is 
illustrated in Figure 12.12. For example, the digraph illustrated there contains the edge 
(a, f) but not the edge (/, a). It does contain both edges (c, d) and (d , c ), however. 

When G is a digraph, a sequence P = (r = uq,u\, . . . ,Ut = x) of distinct vertices 
is called a directed path from r to x when (m;m, + i) is a directed edge in G for every 
i = 0, 1, . . . , t — 1. A directed path C = (r - Mo, Mi, ... ,Ut = x) is called a directed cycle 
when ( Mf , Mo) is a directed edge of G. 

12.3 Dijkstra’s Algorithm for Shortest Paths 

Just as with graphs, it is useful to assign weights to the directed edges of a digraph. 
Specifically, in this section we consider a pair (G, zv) where G = (V, E) is a digraph and 
zv: E —> No is a function assigning to each directed edge (x , y) a non-negative weight 
zo{x, y). However, in this section, we interpret weight as distance so that w(x, y) is 
now called the length of the edge (x, y). If P = (r = uq, u\, . . . , m ( = x) is a directed 
path from r to x, then the length of the path P is just the sum of the lengths of the 
edges in the path, w ( u i u i+i)- The distance from r to x is then defined to be the 
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minimum length of a directed path from r to x. Our goal in this section is to solve the 
following natural problem, which has many applications: 

Problem 12.13. For each vertex x, find the distance from r to x. Also, find a shortest 
path from r to x. 

12.3.1 Description of the Algorithm 

To describe Dijkstra's algorithm in a compact manner, it is useful to extend the defi- 
nition of the function zv. We do this by setting U)(x, y) = oo when x + y and (x, y) is 
not a directed edge of G. In this way, we will treat oo as if it were a number (although 
it is not!). 1 

We are now prepared to describe Dijkstra's Algorithm. 

Algorithm 12.14 (Dijkstra's Algorithm). Let n = | V|. At Step i, where 1 < i < n, we will 
have determined: 

1. A sequence a = {v\, Vi, V 3 , . . . , Vi) of distinct vertices from G with r = v\. These 
vertices are called permanent vertices, while the remaining vertices will he called tem- 
porary vertices. 

1 This is not an issue for computer implementation of the algorithm, as instead of using oo, a value given by 
the product of the number of vertices and the maximum edge weight may be used to simulate infinity. 
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2. For each vertex x e V , we zvill have determined a number 5(x) and a path P(x)from r 
to x of length 5(x). 

Initialization (Step 1) Set i = 1. Set 5(r) = 0 and let P(r) = ( r ) be the trivial one-point 
path. Also, set o = ( r ). For each x + r, set 6(x) = zv (r, x) and P(x) = (r, x). Let x be 
a temporary vertex for zvhich 6(x) is minimum. Set V 2 = x, and update o by appending 
i ’2 to the end of it. Increment i. 

Inductive Step (Step i, i > 1) If i < n, then for each temporary x, let 


<5(x) = min{<5(x), 5(i ;,•) + zv(vj,x)}. 


If this assignment results in a reduction in the value of5(x), let P(x) be the path obtained 
by adding x to the end ofP(z’j). 

Let x be a temporary vertex for zvhich <5(x) is minimum. Set Vi + 1 = x, and update o by 
appending Vj + \ to it. Increment i. 

12.3.2 Example of Dijkstra’s Algorithm 

Before establishing why Dijkstra's algorithm works, it may be helpful to see an example 
of how it works. To do this, consider the digraph G shown in Figure 12.15. For visual 
clarity, we have chosen a digraph which is an oriented graph, i.e., for each distinct pair 
x, y of vertices, the graph contains at most one of the two possible directed edges (x,y) 
and ( y,x ). 

Suppose that the root vertex r is the vertex labeled a. The initialization step of Dijk- 
stra's algorithm then results in the following values for 5 and P : 

Step 1. Initialization 


o = (a) 
5(a) = 0; 
5(b) = oo; 
5(c) = 47; 
5(d) = oo; 
5(e) = 70; 
5(f) = 24; 

5(g) = oo; 
5(h) = oo; 


P(a) = (a) 
P(b) = (a, b) 
P(c) = (a, c) 
P(d) = (a, d) 
P(e) = (a,e) 

P(f) = («,/) 
P(g) = (a ,g) 

P(h) = (a,h) 
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Figure 12.15: A digraph with edge lengths 


Before finishing Step l, the algorithm identifies vertex / as closest to a and appends 
it to o, making a permanent. When entering Step 2, Dijkstra's algorithm attempts to 
find shorter paths from a to each of the temporary vertices by going through /. We 
call this process "scanning from vertex / ." In this scan, the path to vertex d is updated, 
since 5(f) + w(f, d) = 24 + 120 = 144 < oo = w(a, d). 

Step 2. Scan from vertex / 


o = ( a,f ) 


On 

II 

O 

P(a) = (a) 

5(b) = 00; 

P(b) = (a,b) 

5(c) = 47; 

P(c) = (a, c) 

5(d) = 144 = 24 + 120 = 5(f) + w(f, d); 

P(d) = (a,f,d) updated 

5(e) = 70; 

P(e) = (a, e) 

5(f) = 24; 

P(f) = (a,f) 

5 (g) = 00; 

P(g ) = («//) 

5(h) = co; 

P(h) = (a,h) 


Before proceeding to the next step, vertex c is made permanent by making it V 3 . 
In Step 3, therefore, the scan is from vertex c. Vertices b, d, and g have their paths 
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updated. However, although 5(c) + w(c, e) = 47 + 23 = 70 = 5(e), we do not change 
P(e) since 6(e) is not decreased by routing P(e) through c. 


Step 3. Scan from vertex c 

o = (a, f, c) 


On 

II 

o 

P(a) = (a) 


5(b) = 102 = 47 + 55 = 5(c) + w(c, b ); 

P(b) - (a, c, b) 

updated 

6(c) = 47; 

P(c) = (a, c) 


5(d) = 135 = 47 + 88 = 6(c) + w(c, d); 

II 

12 

updated 

5(e) = 70; 

P(e) = (a, e) 


5(f) = 24; 

P(f) = («,/) 


5(g) = H3 = 47 + 66 = 6(c) + w(c, g); 

P(g) = (a, c, g) 

updated 

5(h) = oo; 

P(h) = (a,h) 



Now vertex e is made permanent. 


Step 4. Scan from vertex e 


o = (a, f ,c,e) 

5(a) = 0; 

5(b) = 101 = 70 + 31 = 5(e) + w(e, b ); 
6(c) = 47; 

5(d) = 135; 

6(e) = 70; 

5(f) = 24; 

5(g) = H2 = 70 + 42 = 6(e) + w(e, g); 
5(h) = oo; 


P(a) = (a) 

P(b) = (a, e, b) updated 
P(c) = (a, c) 

P(d) = (a, c, d) 

P(e) = (a, e) 

P(f) = («,/) 

P(g) = (a,e , g) updated 
P(h) = (a,h) 


Now vertex b is made permanent. 
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Step 5. Scan from vertex b 


o = ( a,f,c,e,b ) 

5(a) = 0; 

5(b) = 101; 

6(c) = 47; 

5(d) = 132 = 101 + 31 = 5(b) + w(b, d); 
5(e) = 70; 

5(f) = 24; 

5(g) = 112; 

5(h) = 180 = 101 + 79 = 5(b) + w(b, h); 


P(a) = (a) 

P(b ) = (a, e, b) 

P(c) = (a, c) 

P(d) = (a, e, b, d) updated 
P(e) = (a,e) 

P(f) = (a,f) 

P(g) = (a, e, g) 

P(h) = (a, e, b, h) updated 


Now vertex g is made permanent. 


Step 6. Scan from vertex g 


o = (a,f,c,e,b,g) 

5(a) = 0; 

5(b) = 101; 

6(c) = 47; 

5(d) = 132; 

5(e) = 70; 

5(f) = 24; 

5(g) = 112; 

5(h) = 178 = 112 + 66 = 5(g) + w(g, h); 


P(a) = (a) 

P(b ) = (a, e, b) 

P(c) = (a, c) 

P(d) = (a, e, b , d) 

P(e) = (a, e) 

P(f) = (a,f) 

P(g) = (a, e, g) 

P(h) = (a, e, g, h) updated 


Now vertex d is made permanent. 


244 



12.3 Dijkstm's Algorithm for Shortest Paths 


Step 7. Scan from vertex d 


a = (a,f,c,e,b,g,d) 

5(a) = 0; 

P(a) = (a) 

5(b) = 101; 

P(b) = (a, e, b) 

6(c) = 47; 

P(c) = (a, c) 

5(d) = 132; 

P(d) = (a, e, b, d) 

5(e) = 70; 

P(e) = (a,e) 

5(f) = 24; 

P(f) = («,/) 

5(g) = 112; 

P(g) = (a,e,g) 

5(h) = 161 = 132 + 29 = 5(d) + w(d, h); 

P(h) = (a, e, b, d, h) updated 

Now vertex li is made permanent. Since this is the last vertex, the algorithm 
and returns the following: 

Final Results of Dijkstra’s Algorithm 


o = (a,f,c,e,b,g,d,h) 

5(a) = 0; 

P(a) = (a) 

5(b) = 101; 

P(b) = (a, e, b) 

6(c) = 47; 

P(c) = (fl,c) 

5(d) = 132; 

P(d) = (a, e, b, d) 

5(e) = 70; 

P(e) = (a, e) 

5(f) = 24; 

P(f) = (a,f) 

5(g) = 112; 

P(g) = (a,e,g) 

5(h) = 161; 

P(h) = (a,e,b,d,h) 


12.3.3 The Correctness of Dijkstra’s Algorithm 

Now that we've illustrated Dijkstra's algorithm, it's time to prove that it actually does 
what we claimed it does: find the distance from the root vertex to each of the other 
vertices and a path of that length. To do this, we first state two elementary propositions. 
The first is about shortest paths in general, while the second is specific to the sequence 
of permanent vertices produced by Dijkstra's algorithm. 
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Proposition 12.16. Let x be a vertex and let P = (r = no, u\, . . . , u t = x) he a shortest path 
from r to x. Then for every integer j with 0 < j < t, (uq, u\, . . . , Uj ) is a shortest path from r 
to iii and ( Uj , Uj+\, . . . , u t ) is a shortest path from u< to Ut 

Proposition 12.17. When the algorithm halts, let a = (v\, v 2 , V 3 , ... , v n ). Then 

<5(z’i) < b(v 2 ) < ■ ■ ■ < 5(v n ). 

We are now ready to prove the correctness of the algorithm. The proof we give will 
be inductive, but the induction will have nothing to do with the total number of vertices 
in the digraph or the step number the algorithm is in. 

Theorem 12.18. Dijkstra's algorithm yields shortest paths for every vertex x in G. That is, 
when Dijkstra's algorithm terminates, for each x e V, the value 6(x) is the distance from r to 
x and P(x) is a shortest path from r to x. 

Proof. The theorem holds trivially when x = r. So we consider the case where x + r. 
We argue that b(x) is the distance from r to x and that P(x) is a shortest path from r 
to x by induction on the minimum number k of edges in a shortest path from r to x. 
When k = 1, the edge (r, x) is a shortest path from r to x. Since v\ = r , we will set 
5(x) = w(r, x) and P(x) = ( r , x) at Step 1. 

Now fix a positive integer k. Assume that if the minimum number of edges in a 
shortest path from r to x is at most k, then b(x) is the distance from r to x and P(x) is 
a shortest path from r to x. Let x be a vertex for which the minimum number of edges 
in a shortest path from r to x is k + 1. Fix a shortest path P = (wo, u\ , u 2 , . . . , Uk+i) 
from r = uo to x = Uk+i ■ Then Q = (no, u\,. . . , Uk ) is a shortest path from r to Uk ■ (See 
Figure 12.19.) 



By the inductive hypothesis, 5(iik) is the distance from r to Uk, and P(iik ) is a shortest 
path from r to Uk ■ Note that P(iik) need not be the same as path Q, as we suggest in 
Figure 12.19. However, if distinct, the two paths will have the same length, namely 
b(iik). Also, the distance from r to x is 5(iik) + w(tik,x ) > b{uk) since P is a shortest 
path from r to x and w(uk, x) > 0. 
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Let i and j be the unique integers for which ui c = v, and x = Vj. If j < i, then 

<5(x) = b(vj) < 5(vi) = 5(u k ) < 5(u k ) + w(u k ). 

Therefore the algorithm has found a path P(x) from r to x having length 5(x) which is 
at most the distance from r to x. Clearly, this implies that 6(x) is the distance from r to 
x and that P(x) is a shortest path. 

On the other hand, if j > i, then the inductive step at Step i results in 
5(x) < 5(vj) + w(vi, y) = 5(u k ) + w(u k , x). 

As before, this implies that 6(x) is the distance from r to x and that P(x) is a shortest 
path. □ 

12.4 Historical Notes 

Kruskal's algorithm was published in 1956 by Joseph B. Kruskal in a three-page paper 
that appeared in Proceedings of the American Mathematical Society. Robert C. Prim pub- 
lished the algorithm that now bears his name the following year in The Bell System Tech- 
nical Journal. Prim's paper focuses on application of the minimum weight (or length or 
cost) spanning tree problem to telephone networks. He was aware of Kruskal's prior 
work, as they were colleagues at Bell Laboratories at the time he published his paper. 
It turns out that Prim had been beaten to the punch by Czech mathematician Vojtech 
Jarnik in 1929, so some refer to Prim's algorithm as Jarnik's algorithm. (It was later re- 
discovered by Dijkstra, so some attach his name as well, referring to it as the Dijkstra- 
Jarnik-Prim algorithm.) Edsger Dijkstra published his algorithm for finding shortest 
paths in 1959 in a three-page paper 1 appearing in Numerische Mathematik. In fact, Di- 
jkstra's algorithm had been discovered (in an equivalent form) by Edward F. Moore 
two years earlier. His result appeared in Proceedings of an International Symposium on 
the Theory of Switching. 


12.5 Exercises 

1. For the graph in Figure 12.20, use Kruskal's algorithm ("avoid cycles") to find a 
minimum weight spanning tree. Your answer should include a complete list of the 
edges, indicating which edges you take for your tree and which (if any) you reject in 
the course of running the algorithm. 

1 This is also the paper in which Prim's algorithm was published for the third time. Dijkstra was aware of 
Kruskal's prior work but argued that his algorithm was preferable because it required that less informa- 
tion about the graph be stored in memory at each step of the algorithm. 
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Figure 12.20: Find a minimum weight spanning tree 


2 . For the graph in Figure 12.20, use Prim's algorithm ("build tree") to find a minimum 
weight spanning tree. Your answer should list the edges selected by the algorithm in 
the order they were selected. 

3. For the graph in Figure 12.21, use Kruskal's algorithm ("avoid cycles") to find a 
minimum weight spanning tree. Your answer should include a complete list of the 
edges, indicating which edges you take for your tree and which (if any) you reject in 
the course of running the algorithm. 



Figure 12.21: Find a minimum weight spanning tree 
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4. For the graph in Figure 12.21, use Prim's algorithm ("build tree") to find a minimum 
weight spanning tree. Your answer should list the edges selected by the algorithm in 
the order they were selected. 

5. For the graph in Figure 12.22, use Kruskal's algorithm ("avoid cycles") to find a 
minimum weight spanning tree. Your answer should include a complete list of the 
edges, indicating which edges you take for your tree and which (if any) you reject in 
the course of running the algorithm. 



Figure 12.22: Find a minimum weight spanning tree 


6. For the graph in Figure 12.22, use Prim's algorithm ("build tree") to find a minimum 
weight spanning tree. Your answer should list the edges selected by the algorithm in 
the order they were selected. 

7. A new local bank is being created and will establish a headquarters h, two branches 
b] and M and four ATMs ti \, 112 , 03 , and ci\. They need to build a computer network 
such that the headquarters, branches, and ATMs can all intercommunicate. Further- 
more, they will need to be networked with the Federal Reserve Bank of Atlanta, /. The 
costs of the feasible network connections (in units of $ 10 , 000 ) are listed below: 


hf 

80 

hh 

10 

hb 2 

20 

M 2 

8 

fb 1 

12 

fa 1 

20 

Mi 

3 

UlCl 2 

13 

I 1 CI 2 

6 

f?2^2 

9 

M 3 

40 

CL \ Cl 4 

3 

«3 fl 4 

6 








The bank wishes to minimize the cost of building its network (which must allow for 
connection, possibly routed through other nodes, from each node to each other node). 
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however due to the need for high-speed communication, they must pay to build the 
connection from h to / as well as the connection from U to aj. Give a list of the con- 
nections the bank should establish in order to minimize their total cost, subject to this 
constraint. Be sure to explain how you selected the connections and how you know 
the total cost is minimized. 

8. A disconnected weighted graph obviously has no spanning trees. However, it is 
possible to find a spanning forest of minimum weight in such a graph. Explain how to 
modify both Kruskal's algorithm and Prim's algorithm to do this. 

9. Prove Proposition 12.3. 

10. In the paper where Kruskal's algorithm first appeared, he considered the algo- 
rithm a route to a nicer proof that in a connected weighted graph with no two edges 
having the same weight, there is a unique minimum weight spanning tree. Prove this 
fact using Kruskal's algorithm. 

11. Use Dijkstra's algorithm to find the distance from a to each other vertex in the 
digraph shown in Figure 12.23 and a directed path of that length. 



Figure 12.23: A directed graph 


12. Table 12.24 contains the length of the directed edge ( x , y ) in the intersection of row 
x and column y in a digraph with vertex set {a, b, c, d, e, /}. For example, w(b, d) =21. 
(On the other hand, zv(d, b) = 10.) Use this data and Dijkstra's algorithm to find the 
distance from a to each of the other vertices and a directed path of that length from a. 
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w 

a 

b 

c 

d 

e 

/ 

a 

0 

12 

8 

43 

79 

35 

b 

93 

0 

18 

21 

60 

33 

c 

17 

3 

0 

37 

50 

30 

d 

85 

10 

91 

0 

17 

7 

e 

28 

47 

39 

14 

0 

108 

f 

31 

7 

29 

73 

20 

0 


Table 12 . 24 : A digraph represented as a table of data 


13 . Use Dijkstra's algorithm to find the distance from a to each other vertex in the 
digraph shown in Figure 12.25 and a directed path of that length. 



Figure 12 . 25 : A directed graph 


14 . Table 12.26 contains the length of the directed edge (x, y ) in the intersection of row 
x and column y in a digraph with vertex set {a, b, c, d, e, /}. For example, w(b , d) = 47. 
(On the other hand, w(d, b) = 6.) Use this data and Dijkstra's algorithm to find the 
distance from a to each of the other vertices and a directed path of that length from a. 
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w 

a 

b 

c 

d 

e 

/ 

a 

0 

7 

17 

55 

83 

42 

b 

14 

0 

13 

47 

27 

17 

c 

37 

42 

0 

16 

93 

28 

d 

10 

6 

8 

0 

4 

32 

e 

84 

19 

42 

8 

0 

45 

f 

36 

3 

76 

5 

17 

0 


Table 12 . 26 : A digraph represented as a table of data 


15 . Give an example of a digraph having an undirected path between each pair of ver- 
tices, but having a root vertex r so that Dijkstra's algorithm cannot find a path of finite 
length from r to some vertex x. 

16 . Notice that in our discussion of Dijkstra's algorithm, we required that the edge 
weights be nonnegative. If the edge weights are lengths and meant to model distance, 
this makes perfect sense. However, in some cases, it might be reasonable to allow 
negative edge weights. For example, suppose that a positive weight means there is 
a cost to travel along the directed edge while a negative edge weight means that you 
make money for traveling along the directed edge. In this case, a directed path with 
positive total weight results in paying out to travel it, while one with negative total 
weight results in a profit. 

(a) Give an example to show that Dijkstra's algorithm does not always find the path 
of minimum total weight when negative edge weights are allowed. 

(b) Bob and Xing are considering this situation, and Bob suggests that a little modi- 
fication to the algorithm should solve the problem. He says that if there are neg- 
ative weights, they just have to find the smallest (i.e., most negative weight) and 
add the absolute value of that weight to every directed edge. For example, if 
w(x, y) > -10 for every directed edge (x, y), Bob is suggesting that they add 10 
to every edge weight. Xing is skeptical, and for good reason. Give an example to 
show why Bob's modification won't work. 
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CHAPTER 


Network Flows 


This chapter continues our look at the topics of algorithms and optimization. On an 
intuitive level, networks and network flows are fairly simple. We want to move some- 
thing (merchandise, water, data) from an initial point to a destination. We have a set of 
intermediate points (freight terminals, valves, routers) and connections between them 
(roads, pipes, cables) with each connection able to carry a limited amount. The natu- 
ral goal is to move as much as possible from the initial point to the destination while 
respecting each connection's limit. Rather than just guessing at how to perform this 
maximization, we will develop an algorithm that does it. We'll also see how to easily 
justify the optimality of our solution though the classic Max Flow-Min Cut Theorem. 


13.1 Basic Notation and Terminology 

A directed graph in which for each pair of vertices x, y at most one of the directed 
edges (x, y) and ( y , x) between them is present is called an oriented graph. The basic 
setup for a network flow problem begins with an oriented graph G, called a network, 
in which we have two special vertices called the source and the sink. We use the letter S 
to denote the source, while the letter T is used to denote the sink (terminus). All edges 
incident with the source are oriented away from the source, while all edges incident 
with the sink are oriented with the sink. Furthermore, on each edge, we have a non- 
negative capacity, which functions as a constraint on how much can be transmitted via 
the edge. The capacity of the edge e = (x,y) is denoted c(e) or by c{x,y). Inacomputer 
program, the nodes of a network may be identified with integer keys, but in this text, 
we will typically use letters in labeling the nodes of a network. This helps to distinguish 
nodes from capacities in diagrams of networks. We illustrate a network in Figure 13.1. 
The numbers associated with the edges are their capacities, so, for instance, c(E,B) = 
24 and c(A, T ) = 56. 

A flow (p in a network is a function which assigns to each directed edge e = (x, y) 
a non-negative value c p(e) = (p(x, y) < c(x, y) so that the following conservation laws 
hold: 
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1. Yjx ( p(S, x) = Yjx <p( x , T), i.e., the amount leaving the source is equal to the amount 
arriving at the sink. This quantity is called the value of the flow <p. 


2. For every vertex y which is neither the source nor the sink the amount leaving y 
is equal to the amount entering y. That is, (p(x, y) = £_ t cp(y, x). 


We illustrate a flow in a network in Figure 13.2. 

In this figure, the numbers associated with each edge are its capacity and the amount 
of flow that <p places on that edge. For example, the edge (£, D) has capacity 20 and 
currently carries a flow of 8. (Since (p(x, y) < c(x, y), it is always easy to determine 
which number is the capacity and which is the flow.) The value of this flow is 30 = 
(p(S, F ) + cp(S, B) + (p(S, E ) = cp(A, T) + (p(C, T). To see that the second conservation law 
holds at, for example, vertex B, note that the flow into B is (p(S, B) + <p(E, B) + <p(D, B) = 
20 and the flow out of B is <p(B,F ) + <p(B,A ) + <p(B, C) = 20. 

Given a network, it is very easy to find a flow. We simply assign cp(e) = 0 for ev- 
ery edge e. It is very easy to underestimate the importance of this observation, actu- 
ally. Network flow problems are a special case of a more general class of optimization 
problems known as linear programs, and in general, it may be very difficult to find 
a feasible solution to a linear programming problem. In fact, conceptually, finding a 
feasible solution — any solution — is just as hard as finding an optimal solution. 
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13.2 Flows and Cuts 

Considering the applications suggested at the beginning of the chapter, it is natural to 
ask for the maximum value of a flow in a given network. Put another way, we want 
to find the largest number Vo so that there exists a flow <p of value Vq in the network. 
Of course, we not only want to find the maximum value vq, but we also want to find 
a flow <p having this value. Although it may seem a bit surprising, we will develop an 
efficient algorithm which both finds a flow of maximum value and finds a certificate 
verifying the claim of optimality. This certificate makes use of the following important 
concept. 

A partition V = L U U of the vertex set V of a network with S £ L and T £ U is called 
a cut . 1 The capacity of a cut V = L U If, denoted c(L, If), is defined by 

c(L,U)= Yj c(x, y). 

xeL,yeU 


Put another way, the capacity of the cut V = L U If is the total capacity of all edges 
from L to If. Note that in computing the capacity of the cut V = LUU, we only add the 
capacities of the edges from L to If. We do not include the edges from If to L in this 
sum. 


J Our choice of L and U for the names of the two parts of the partition will make more sense later in the 
chapter. 
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Example 13.3. Let's again take a look at the network in Figure 13.2. Let's first consider 
the cut V = Li U Ui with 

L 1 ={S,F,B,E,D} and Ui = {A,C,T}. 

Here we see that the capacity of the cut is 

c(Li, lii) = c(F,A ) + c(B,A ) + c(B, C) + c(D , C) = 24 + 15 + 20 + 42 = 101. 

We must be a bit more careful, however, when we look at the cut V - L 2 U U 2 with 

L 2 = {S,F,B,E} and U 2 = {A,D,C,T}. 


Here the capacity of the cut is 

c(L 2 , U 2 ) = c(F,A) + c(B,A ) + c(B, C) + c(E, D) = 24 + 15 + 20 + 20 = 79. 

Notice that we do not include c(D, B) in the calculation as the directed edge (D, B) is 
from U 2 to L 2 . 

The relationship between flows and cuts rests on the following fundamentally im- 
portant theorem. 

Theorem 13.4. Let G = (V, E) be a network, let cp be a flow in G, and letV = LcUbea cut. 
The value of the flow is at most as large as the capacity of the cut. 

Proof. In this proof (and throughout the chapter), we adopt the very reasonable con- 
vention that <p(x , y) = 0 if ( x , if) is not a directed edge of a network G. 

Let (p be a flow of value zy and let V = L U U be a cut. First notice that 


w = Y s ' y) - 2 j 0( z,s )' 

yeV zeV 


since the second summation is 0. Also, by the second of our flow conservation laws, 
we have for any vertex other than the source and the sink, 

Y^ x '^~Y^ z,x ^ =0 - 

yeV zeV 
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Now we have 






ycV 


zeV 


Y <P( s / y) - Y <P(z, s) + Y 


yeV 


Z 

xeL 


zeV 


xeL 


Y^'^-Y^ 2 '^ 

yeV 


zeV 


Yj^ x ' x j)- Y <p(z,x) 

yeV 


zey 


At this point, we want to pause and look at the last line. Notice that if (a, b ) is a directed 
edge with both endpoints in L, then when the outer sum is conducted for x = a, we get 
an overall contribution of c p(a, b). On the other hand, when it is conducted for x = b, 
we get a contribution of ~(p(a, b ). Thus, the terms cancel out and everything simplifies 
to 

Y c t ) ( x ' y )~Y z ' *) - Y x ' y) - X c(yX ’ y ) = C ( L ' u )• 

a: 6L xeL xeL x€L 

i /ell zeU yell yeU 


Thus r>o ^ c(L, It). 


□ 


Discussion 13.5 (Discussion). Bob's getting a bit of a sense of deja vu after reading 
Theorem 13.4. He remembers from Chapter 5 that the maximum size of a clique in a 
graph is always at most the minimum number of colors required to properly color the 
graph. However, he also remembers that there are graphs without cliques of size three 
but with arbitrarily large chromatic number, so he's not too hopeful that this theorem 
is going to help out much here. Yolanda chimes in with a reminder of Chapter 6, where 
they learned that the maximum size of an antichain in a poset is equal to the minimum 
number of chains into which the ground set of the poset can be partitioned. Alice 
points out that Yolanda's statement is still true if the words "chain" and "antichain" 
are swapped. This sparks some intense debate about whether the maximum value of 
a flow in a network must always be equal to the minimum capacity of a cut in that 
network. After a while, Carlos suggests that continuing to read might be the best idea 
for resolving their debate. 


13.3 Augmenting Paths 

In this section, we develop the classic labeling algorithm of Ford and Fulkerson which 
starts with any flow in a network and proceeds to modify the flow — always increasing 
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the value of the flow — until reaching a step where no further improvements are pos- 
sible. The algorithm will also help resolve the debate Alice, Bob, Carlos, and Yolanda 
were having in the previous section. 

Our presentation of the labeling algorithm makes use of some natural and quite 
descriptive terminology. Suppose we have a network G = (V,E) with a flow cp of value 
v. We call (p the current flow and look for ways to augment (j) by making a relatively 
small number of changes. An edge ( x , y) with c p(x, y) > 0 is said to be used, and when 
c p(x , y) = c(x, y) > 0, we say the edge is full. When cp(x, y) < c(x, y), we say the edge 
(x, y) has spare capacity, and when 0 = cp(x, y) < c(x, y), we say the edge (x, y) is 
empty. Note that we simply ignore edges with zero capacity. 

The key tool in modifying a network flow is a special type of path, and these paths are 
not necessarily directed paths. An augmenting path is a sequence P = (xq, X\, . . . , x m ) 
of distinct vertices in the network such that Xq = S, x m = T, and for each i = 1,2,..., m, 
either 

a (x;_i,x;) has spare capacity or 
b (x;,X;_i) is used. 

When condition (a) holds, it is customary to refer to the edge (x;-i, xf) as a forward 
edge of the augmenting path P. Similarly, if condition (b) holds, then the (nondirected) 
edge (x;_i, X;) is called a backward edge since the path moves from x,-_ \ to x u which 
is opposite the direction of the edge. 

Example 13.6. Let's look again at the network and flow in Figure 13.2. The sequence 
of vertices (S, F, A, T ) meets the criteria to be an augmenting path, and each edge in it 
is a forward edge. Notice that increasing the flow on each of (S, F), (F, A), and ( A , T) 
by any positive amount 5 < 12 results in increasing the value of the flow and preserves 
the conservation laws. 

If our first example jumped out at you as an augmenting path, it's probably less clear 
at a quick glance that {S,E ,D ,C,B , A,T) is also an augmenting path. All of the edges 
are forward edges except for (C, B), since it's actually (B, C) that is a directed edge in 
the network. Don't worry if it's not clear how this path can be used to increase the 
value of the flow in the network, as that's our next topic. 

Ignoring, for the moment, the issue of finding augmenting paths, let's see how they 
can be used to modify the current flow in a way that increases its value by some 6 > 0. 
Here's how for an augmenting path P = (xo, x\, . . . , x m ). First, let (V| be the positive 
number defined by: 


§1 = min{c(x ( _ 1/ x,) - <p(xi_i, X;) : (x,_i, x,j a forward edge of P.} 


258 


13.3 Augmenting Paths 


The quantity c(x;_ i,x,) - 0 ( 2 ',- 1 , x,j is nothing but the spare capacity on the edge 
( ), and thus 61 is the largest amount by which all of the forward edges of P. 
Note that the edges (xo,xi) and (x m _i,x m ) are always forward edges, so the positive 
quantity 61 is defined for every augmenting path. 

When the augmenting path P has no backward edges, we set 5 = 61 . But when P 
has one or more backward edges, we pause to set 

62 = min{cp(xi, x;_i) : (x;_i, x,) a backward edge of P}. 

Since every backward edge is used, 62 > 0 whenever we need to define it. We then set 
5 = min{Si, 621 - 

In either case, we now have a positive number 6 and we make the following elemen- 
tary observation, for which you are asked to provide a proof in Exercise 13.7.4. 

Proposition 13.7. Suppose we have an augmenting path P = (xo,xi, . . . , x m ) with 6 > 0 
calculated as above. Modify the flow (p by changing the values along the edges of the path P by 
an amount which is either +6 or -6 according to the follozving rules: 

1. Increase the flow along the edges ofP which are forwards. 

2. Decrease the flow along the edges ofP zvhich are backwards. 

Then the resulting function (p is a flow and it has mine v + 5. 

Example 13.8. The network flow shown in Figure 13.2 has many augmenting paths. 
We already saw two of them in Example 13.6, which we call P 1 and P 3 below. In the 
list below, be sure you understand why each path is an augmenting path and how the 
value of 6 is determined for each path. 

1. Pi = (S, F, A, T ) with 6 = 12. All edges are forward. 

2. P 2 = (S, B, A, T ) with 6 = 8 . All edges are forward. 

3. P 3 = (S, E, D, C, B, A, T ) with 6 = 9. All edges are forward, except (C, B) which 
is backward. 

4. P 4 = (S, B, E, D, C, A, T) with 6=2. All edges are forward, except ( B,E ) and 
(C, A) which are backward. 

In Exercise 13.7.7, you are asked to update the flow in Figure 13.2 for each of these 
four paths individually. 
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13.3.1 Caution on Augmenting Paths 

Bob's gotten really good at using augmenting paths to increase the value of a network 
flow. He's not sure how to find them quite yet, but he knows a good thing when he sees 
it. He's inclined to think that any augmenting path will be a good deal in his quest for 
a maximum-valued flow. Carlos is pleased about Bob's enthusiasm for network flows 
but is beginning to think that he should warn Bob about the dangers in using just any 
old augmenting path to update a network flow. They agree that the best situation is 
when the number of updates that need to be made is small in terms of the number of 
vertices in the network and that the size of the capacities on the edges and the value of 
a maximum flow should not have a role in the number of updates. 

Bob says he can't see any way that the edge capacities could create a situation where 
a network with only a few vertices requires many updates, Carlos is thinking that an 
example is in order. He asks Bob to pick his favorite very large integer and to call 
it M. He then draws the network on four vertices shown in Figure 13.9. Bob quickly 
recognizes that the maximum value of a flow in this network is 2 M. He does this using 
the flow with (p(S,A) = M, cp(A, T ) = M, c p(S, B ) = M, c p(B , T) = M and <p(A, B ) = 0. 
Carlos is pleased with Bob's work. 


A 



Figure 13 . 9 : A Small Network 


Since this network is really small, it was easy for Bob to find the maximum flow. 
However, Bob and Carlos agree that "eyeballing" is not an approach that scales well 
to larger networks, so they need to have an approach to finding that flow using aug- 
menting paths. Bob tells Carlos to give him an augmenting path, and he'll do the 
updating. Carlos suggests the augmenting path (S, A, B, T ), and Bob determines that 
5 = 1 for this augmenting path. He updates the network (starting from the zero flow, 
i.e., with d>(e) = 0 for every edge e) and it now has value 1. Bob asks Carlos for another 
augmenting path, so Carlos gives him (S, B, A, T). Now ( B,A ) is backward, but that 
doesn't phase Bob. He performs the update, obtaining a flow of value 2 with (A, B ) 
empty again. 
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Despite Carlos' hope that Bob could already see where this was heading. Bob ea- 
gerly asks for another augmenting path. Carlos promptly gives him (S, A, B, T), which 
again has 5 = 1. Bob's update gives them a flow of value 3. Before Carlos can sug- 
gest another augmenting path. Bob realizes what the problem is. He points out that 
Carlos can just give him ( S,B,A,T ) again, which will still have 6 = 1 and result in 
the flow value increasing to 4. He says that they could keep alternating between those 
two augmenting paths, increasing the flow value by 1 each time, until they'd made 2 M 
updates to finally have a flow of value 2M. Since the network only has four vertices 
and M is very large, he realizes that using any old augmenting path is definitely not a 
good idea. 

Carlos leaves Bob to try to figure out a better approach. He realizes that starting from 
the zero flow, he'd only need the augmenting paths (S, A, T ) and (S, B , T), each with 6 = 
M to quickly get the maximum flow. However, he's not sure why an algorithm should 
find those augmenting paths to be preferable. About this time, Dave wanders by and 
mumbles something about the better augmenting paths using only two edges, while 
Carlos' two evil augmenting paths each used three. Bob thinks that maybe Dave's onto 
something, so he decides to go back to reading his textbook. 


13.4 The Ford-Fulkerson Labeling Algorithm 

In this section, we outline the classic Ford-Fulkerson labeling algorithm for finding a 
maximum flow in a network. The algorithm begins with a linear order on the vertex 
set which establishes a notion of precedence. Typically, the first vertex in this lin- 
ear order is the source while the second is the sink. After that, the vertices can be 
listed in any order. In this book, we will use the following convention: the vertices 
will be labeled with capital letters of the English alphabet and the linear order will be 
(S, T, A, B, C, D,E,F, G, . . . ), which we will refer to as the pseudo-alphabetic order. 
Of course, this convention only makes sense for networks with at most 26 vertices, but 
this limitation will not cramp our style. For real world problems, we take comfort in 
the fact that computers can deal quite easily with integer keys of just about any size. 

Before providing a precise description of the algorithm, let's take a minute to con- 
sider a general overview. In carrying out the labeling algorithm, vertices will be clas- 
sified as either labeled or unlabeled. At first, we will start with only the source being 
labeled while all other vertices will be unlabeled. By criteria yet to be spelled out, 
we will systematically consider unlabeled vertices and determine which should be la- 
beled. If we ever label the sink, then we will have discovered an augmenting path, and 
the flow will be suitably updated. After updating the flow, we start over again with 
just the source being labeled. 

This process will be repeated until (and we will see that this always occurs) we reach 
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a point where the labeling halts with some vertices labeled (one of these is the source) 
and some vertices unlabeled (one of these is the sink). We will then note that the par- 
tition V = L U U into labeled and unlabeled vertices (hence our choice of L and U as 
names) is a cut whose capacity is exactly equal to the value of the current flow. This 
resolves the debate from earlier in the chapter and says that the maximum flow / min- 
imum cut question is more like antichains and partitioning into chains than clique 
number and chromatic number. In particular, the labeling algorithm will provide a 
proof of the following theorem: 

Theorem 13.10 (The Max Flow-Mi n Cut Theorem). Let G = (V, E) be a network. If vq is 
the maximum mine of a flow and c o is the minimum capacity Co of a cut, then vo = co- 

We're now ready to describe the Ford-Fulkerson labeling algorithm in detail. 
Algorithm 13.11 (Ford-Fulkerson Labeling Algorithm). 

Labeling the Vertices Vertices will be labeled with ordered triples of symbols. Each time we 
start the labeling process, we begin by labeling the source with the triple (*, +, oo). The 
rides by which we label vertices will be explicit. 

Potential on a Labeled Vertex Let u be a labeled vertex. The third coordinate of the label 
given to u will be positive real number — although it may be infinite. We call this quantity 
the potential on u and denote it by p(u). (The potential zvill serve as the amount that 
the flow can be updated by.) Note that the potential on the source is infinite. 

First Labeled, First Scanned The labeling algorithm involves a scan from a labeled vertex u. 
As the vertices are labeled, they determine another linear order. The source will alzvays 
be the first vertex in this order. After that, the order in zvhich vertices are labeled zvill 
change with time. But the important ride is that zve scan vertices in the order that they 
are labeled — until zve label the sink. If for example, the initial scan — alzvays done from the 
source — results in labels being applied to vertices D, G and M, then zve next scan from 
vertex D. If that scan residts in vertices B,F, G and Q being labeled, then zve next scan 
from G, as it zvas labeled before B, even though B precedes G in the pseudo-alphabetic 
order. This aspect of the algorithm residts in a breadth-first search of the vertices looking 
for zvays to label previously unlabeled vertices. 

Never Relabel a Vertex Once a vertex is labeled, zve do not change its label. We are content 
to label previously unlabeled vertices — up until the time zvhere zve label the sink. Then, 
after updating the flow and increasing the value, all labels, except of course the special 
label on the source, are discarded and zve start all over again. 

Labeling Vertices Using Forward Edges Suppose we are scanning from a labeled vertex u 
with potential p(u) > 0. From u, zve consider the unlabeled neighbors of u in pseudo- 
alphabetic order. Nozv suppose that zve are looking at a neighbor v of u with the edge 
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( u,v ) belonging to the netzvork. This means that the edge is directed from u to v. If 
e = ( u , v ) is not full, then zve label the vertex v with the triple (m, +, p(v)) where p(v) = 
min{p(»), c(e) - (p(e )}. We use this definition since the flow cannot be increased by 
more than the prior potential or the spare capacity on e. Note that the potential p(z>) is 
positive since a is the minimum oftzvo positive numbers. 


Labeling Vertices Using Backward Edges Nozv suppose that zve are looking at a neighbor 
v ofu with the edge ( v , u) belonging to the netzvork. This means that the edge is directed 
from v to u. If e = ( v , u) is used, then zve label the vertex v with the triple (», p(v)) 

zvhere p(v) = min {p(u), (p(e)}. Here p(z>) is defined this zvay since theflozv on e cannot 
be decreased by more than (p(e) or p(u). Again, note that the potential p(v) is positive 
since a is the minimum oftzvo positive numbers. 


What Happens When the Sink is Labeled? The labeling algorithm halts if the sink is ever 
labeled. Note that zve are alzvays trying our best to label the sink, since in each scan the 
sink is the very first vertex to be considered. Nozv suppose that the sink is labeled with 
the triple (», +, a). Note that the second coordinate on the label must be + since all edges 
incident with the sink are oriented tozvards the sink. 

We claim that zve can find an augmenting path P which results in an increased flow with 
5 = a, the potential on the sink. To see this, zve merely back-track. The sink T got its label 
from u = Mi, Mi got its label from M 2 , and so forth. Eventually, zve discover a vertex u m 
zvhich got its label from the source. The augmenting path is then 

P = (S, U m , U m —\, . ■ . , Ml, T). 

The value of 5 for this path is the potential p(T) on the sink since we've carefidly ensured 
that p(u m ) > p(u m -i) > > p( Mi) > p(T). 


And if the Sink is Not Labeled? On the other hand, suppose zve have scanned from every 
labeled vertex and there are still unlabeled vertices remaining, one of zvhich is the sink. 
Nozv zve claim victory. To see that zve have zvon, zve simply observe that if L is the set of 
labeled vertices, and U is the set of unlabeled vertices, then every edge e = ( x , y) with 
x £ L and y £ U is full, i.e., <p(e) = c(e). If this zvere not the case, then y would qualify 
for a label with x as the first coordinate. Also, note that cp(y, x) = 0 for every edge e with 
x e L and y £ U. Regardless, zve see that the capacity of the cut V = L U U is exactly 
equal to the value of the current flow, so zve have both a maximum flow and minimum cut 
providing a certificate of optimality. 
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13.5 A Concrete Example 

Let's apply the Labeling Algorithm to the network flow shown in Figure 13.2. Then we 
start with the source: 

S : (*,+,oo) 

Since the source S is the first vertex labeled, it is also the first one scanned. So we look 
at the neighbors of S using the pseudo-alphabetic order on the vertices. Thus, the first 
one to be considered is vertex B and since the edge (S, B) is not full, we label B as 

B: (S,+, 8). 

We then consider vertex E and label it as 

E: (S, +,28). 

Next is vertex F, which is labeled as 

F: (S, +,15). 

At this point, the scan from S is complete. 

The first vertex after S to be labeled was B, so we now scan from B. The (unlabeled) 
neighbors of B to be considered, in order, are A, C, and D. This results in the following 
labels: 


A : 

(B, +, 8) 

C : 

(B, +, 8) 

D : 

(B,-,6) 


The next vertex to be scanned is E, but E has no unlabeled neighbors, so we then move 
on to F, which again has no unlabeled neighbors. Finally, we scan from A, and using 
the pseudo-alphabetic order, we first consider the sink T (which in this case is the only 
remaining unlabeled vertex). This results in the following label for T. 

T: {A, +, 8) 

Now that the sink is labeled, we know there is an augmenting path. We discover this 
path by backtracking. The sink T got its label from A, A got its label from B, and B 
got its label from S. Therefore, the augmenting path is P = (S, B,A,T) with 5 = 8. All 
edges on this path are forward. The flow is then updated by increasing the flow on the 
edges of P by 8. This results in the flow shown in Figure 13.12. The value of this flow 
is 38. 
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Figure 13.12: An Updated Network Flow 


Here is the sequence (reading down the columns) of labels that will be found when 
the labeling algorithm is applied to this updated flow. (Note that in the scan from S, 
the vertex B will not be labeled, since now the edge (S, B) is full.) 


S : (*, +,oo) 

£: (S, +,28) 
F: (S, +, 15) 
B: (E, +,19) 


D : (£, +, 12) 
A : (F, +, 12) 
C: (B,+, 10) 
T: (A, +,12) 


This labeling results in the augmenting path P = (S, F, A, T ) with 5 = 12. 

After this update, the value of the flow has been increased and is now 50 = 38 + 12. 
We start the labeling process over again and repeat until we reach a stage where some 
vertices (including the source) are labeled and some vertices (including the sink) are 
unlabeled. 


13.5.1 How the Labeling Algorithm Halts 

Consider the network flow in Figure 13.13. 
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Figure 13.13: Another Network Flow 


The value of the current flow is 172. Applying the labeling algorithm using the 
pseudo-alphabetic order results in the following labels (reading down the columns): 


(*,+,o°) 

E : (f, -,3) 

(S,+, 8) 

G: (£,-,3) 

(S, +,23) 

£ : (£,+,3) 

(C, +, 7) 

B : (G,+,3) 

(H,+,7) 

T: (£,+,3) 


These labels result in the augmenting path P = (S, C, H, I, E, L, T) with 6 = 3. After 
updating the flow and increasing its value to 175, the labeling algorithm halts with the 
following labels: 

S: (*,+,») H : (C,+, 4) 

C: (S,+, 5) I: (H,+, 4) 

F : (S, +,23) 
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Now we observe that the labeled and unlabeled vertices are L = {S, C, F, H, 1} and 
U = {T,A,B, D, E, G, /, K}. Furthermore, the capacity of the cut V = L U U is 

41 + 8 + 23 + 8 + 13 + 29 + 28 + 25 = 175. 

This shows that we have found a cut whose capacity is exactly equal to the value of the 
current flow. In turn, this shows that the flow is optimal. 


13.6 Integer Solutions of Linear Programming Problems 

A linear programming problem is an optimization problem that can be stated in the 
following form: Find the maximum value of a linear function 


C\X\ + C2X2 + C 3X3 H + C„X„ 

subject to m constraints C\, C 2 , . . . , C m , where each constraint C, is a linear equation 
of the form: 

C i : anx 1 + aj 2X2 + a\ 3X3 + • • • + ai n Xn — bj 

where all coefficients and constants are real numbers. 

While the general subject of linear programming is far too broad for this course, we 
would be remiss if we didn't point out that: 

1 . Linear programming problems are a very important class of optimization prob- 
lems and they have many applications in engineering, science, and industrial 
settings. 

2. There are relatively efficient algorithms for finding solutions to linear program- 
ming problems. 

3. A linear programming problem posed with rational coefficients and constants 
has an optimal solution with rational values — if it has an optimal solution at all. 

4. A linear programming problem posed with integer coefficients and constants 
need not have an optimal solution with integer values — even when it has an op- 
timal solution with rational values. 

5. A very important theme in operations research is to determine when a linear 
programming problem posed in integers has an optimal solution with integer 
values. This is a subtle and often very difficult problem. 

6. The problem of finding a maximum flow in a network is a special case of a linear 
programming problem. 
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7. A network flow problem in which all capacities are integers has a maximum flow 
in which the flow on every edge is an integer. The Ford-Fulkerson labeling algo- 
rithm guarantees this! 

8. In general, linear programming algorithms are not used on networks. Instead, 
special purpose algorithms, such as Ford-Fulkerson, have proven to be more ef- 
ficient in practice. 

13.7 Exercises 

1. Consider the network diagram in Figure 13.14. For each directed edge, the first 

number is the capacity and the second value is intended to give a flow <p in the network. 

However, the flow suggested is not valid. 

(a) Identify the reason(s) <p is not valid. 

(b) Without changing any of the edge capacities, modify <p into a valid flow <p. Try to 
use as few modifications as possible. 



Figure 13 . 14 : An invalid flow in a network 


2 . Alice claims to have found a (valid) network flow of value 20 in the network shown 
in Figure 13.15. Bob tells her that there's no way she's right, since no flow has value 
greater than 18. Who's right and why? 
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3. Find an augmenting path P with at least one backward edge for the flow <p in the 
network shown in Figure 13.16. What is the value of 6 for P? Carry out an update of 
(p using P to obtain a new flow (p. What is the value of (t>? 



Figure 13.16: A network with flow 


4. Prove Proposition 13.7. You will need to verify that the flow conservation laws 
hold at each vertex along an augmenting path (other than S and T). There are four 
cases to consider depending on the forward/backward status of the two edges on the 
augmenting path that are incident with the vertex. 
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5 . Find the capacity of the cut (L, If) with 

L = {S,F,H,C,B,G,I} and If = {A,D,E,T} 
in the network shown in Figure 13.16. 

6. Find the capacity of the cut (L, If) with 

L = {S,F,D,B,A} and U = {H,C,I,G,E,T} 
in the network shown in Figure 13.16. 

7 . For each of the augmenting paths Pi, P 2 , P 3 , and P 4 in Example 13.8, update the flow 
in Figure 13.2. (Note that your solution to this exercise should consist of four network 
flows. Do not attempt to use the four paths in sequence to create one updated network 
flow.) 

8 . Continue running the Ford-Fulkerson labeling algorithm on the network flow in 
Figure 13.12 until the algorithm halts without labeling the sink. Find the value of the 
maximum flow as well as a cut of minimum capacity. 

9 . Use the Ford-Fulkerson labeling algorithm to find a maximum flow and a minimum 
cut in the network shown in Figure 13.17 by starting from the current flow shown there. 


E 



Figure 13 . 17 : A network with flow 
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10 . Figure 13.18 shows a network. Starting from the zero flow, i.e., the flow with cp(e) = 
0 for every directed edge e in the network, use the Ford-Fulkerson labeling algorithm 
to find a maximum flow and a minimum cut in this network. 


B 



Figure 13 . 18 : A network 


1 1 . Consider a network in which the source S has precisely three neighbors: B, £, and 
F. Suppose also that c(S, B) =30, c(S, E) = 20, and c(S, F) = 25. You know that there is 
a flow (p on the network but you do not know how much flow is on any edge. You do 
know, however, that when the Ford-Fulkerson labeling algorithm is run on the network 
with current flow <p, the first two vertices labeled are S with label (*, +, oo) and F with 
label (S, +, 15). Use this information to determine the value of the flow (p and explain 
how you do so. 
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CHAPTER 

Combinatorial Applications of 

Network Flows 


Clearly finding the maximum flow in a network can have many direct applications 
to problems in business, engineering, and computer science. However, you may be 
surprised to learn that finding network flows can also provide reasonably efficient al- 
gorithms for solving combinatorial problems. In this chapter, we consider a restricted 
version of network flows in which each edge has capacity 1 . Our goal is to establish 
algorithms for two combinatorial problems: finding maximum matchings in bipartite 
graphs and finding the width of a poset as well as a minimal chain partition. 


14.1 Introduction 

Before delving into the particular combinatorial problems we wish to consider in this 
chapter, we will state a key theorem. When working with network flow problems, our 
examples thus far have always had integer capacities and we always found a maxi- 
mum flow in which every edge carried an integer amount of flow. It is not, however, 
immediately obvious that this can always be done. Why, for example, could it not be 
the case that the maximum flow in a particularly pathological network with integer 
capacities is 23/3? Or how about something even worse, such as V21tt? We can rule 
out the latter because network flow problems fall into a larger class of problems known 
as linear programming problems, and a major theorem tells us that if a linear program 
is posed with all integer constraints (capacities in our case), the solution must be a 
rational number. However, in the case of network flows, something even stronger is 
true. 

Theorem 14.1. In a network flow problem in which every edge has integer capacity, there is a 
maximum flow in which every edge carries an integer amount of flow. 

Notice that the above theorem does not guarantee that every maximum flow has 
integer flow on every edge, just that we are able to find one. With this theorem in 
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hand, we now see that if we consider network flow problems in which the capacities 
are all 1 we can find a maximum flow in which every edge carries a flow of either 0 or 
1. This can give us a combinatorial interpretation of the flow, in a sense using the full 
edges as edges that we "take" in some useful sense. 

14.2 Matchings in Bipartite Graphs 

Recall that a bipartite graph G = (V,E) is one in which the vertices can be properly 
colored using only two colors. It is clear that such a coloring then partitions V into 
two independent sets Vf and V 2 , and so all the edges are between V\ and V 2 . Bipartite 
graphs have many useful applications, particularly when we have two distinct types 
of objects and a relationship that makes sense only between objects of distinct types. 
For example, suppose that you have a set of workers and a set of jobs for the workers 
to do. We can consider the workers as the set V-\ and the jobs as V 2 and add an edge 
from worker zv e V\ to job j e V 2 if and only if zv is qualified to do /. 

For example, the graph in Figure 14.2 is a bipartite graph in which we've drawn Vj 
on the bottom and V 2 on the top. 



Figure 14.2: A bipartite graph 


If G = {V, E) is a graph, a set M C E is a matching in G if no two edges of M share an 
endpoint. If v is a vertex that is the endpoint of an edge in M, we say that M saturates 
v or v is saturated by M. When G is bipartite with V = V\ U V 2 , a matching is then a 
way to pair vertices in Vi with vertices in V 2 so that no vertex is paired with more than 
one other vertex. We're usually interested in finding a maximum matching, which is 
a matching that contains the largest number of edges possible, and in bipartite graphs 
we usually fix the sets V\ and V 2 and seek a maximum matching from Vi to Vj- In 
our workers and jobs example, the matching problem thus becomes trying to find an 
assignment of workers to jobs such that 

i each worker is assigned to a job for which he is qualified (meaning there's an 
edge), 

ii each worker is assigned to at most one job, and 
iii each job is assigned at most one worker. 
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As an example, in Figure 14.3, the thick edges form a matching from V\ to V3- Sup- 
pose that you're the manager of these workers (on the bottom) and must assign them 
to the jobs (on the top). Are you really making the best use of your resources by only 
putting four of six workers to work? There are no trivial ways to improve the num- 
ber of busy workers, as the two without responsibilities right now cannot do any of 
the jobs that are unassigned. Perhaps there's a more efficient assignment that can be 
made by redoing some of the assignments, however. If there is, how should you go 
about finding it? If there is not, how would you justify to your boss that there's no 
better assignment of workers to jobs? 



Figure 14.3: A matching in a bipartite graph 


At the end of the section, we'll briefly look at a theorem on matchings in bipartite 
graphs that tells us precisely when an assignment of workers to jobs exists that ensures 
each worker has a job. First, however, we want to see how network flows can be used 
to find maximum matchings in bipartite graphs. The algorithm we give, while decent, 
is not the most efficient algorithm known for this problem. Therefore, it is not likely 
to be the one used in practice. Flowever, it is a nice example of how network flows can 
be used to solve a combinatorial problem. The network that we use is formed from a 
bipartite graph G by placing an edge from the source S to each vertex of Vj and an 
edge from each vertex of V2 to the sink T. The edges between Vi and V2 are oriented 
from V\ to Vj, and every edge is given capacity 1. Figure 14.4 contains the network 
corresponding to our graph from Figure 14.2. Edges in this network are all oriented 
from bottom to top and all edges have capacity 1. The vertices in V\ are Xi, ... ,Xs in 
order from left to right, while the vertices in V 2 are yi, . . . , 3/7 from left to right. 

T 



Figure 14.4: The network corresponding to a bipartite graph 
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Now that we have translated a bipartite graph into a network, we need to address the 
correspondence between matchings and network flows. To turn a matching M into a 
network flow, we start by placing one unit of flow on the edges of the matching. To have 
a valid flow, we must also place one unit of flow on the edges from S to the vertices of 
V\ saturated by M. Since each of these vertices is incident with a single edge of M, the 
flow out of each of them is 1, matching the flow in. Similarly, routing one unit of flow 
to T from each of the vertices of Vi saturated by M takes care of the conservation laws 
for the remaining vertices. To go the other direction, simply note that the full edges 
from V\ to Vi in an integer-valued flow is a matching. Thus, we can find a maximum 
matching from Vi to Vi by simply running the labeling algorithm on the associated 
network in order to find a maximum flow. 

In Figure 14.5, we show thick edges to show the edges with flow 1 in the flow corre- 
sponding to our guess at a matching from Figure 14.3. 



Figure 14 . 5 : The flow corresponding to a matching 


With priority sequence S,T,Xi,Xi, . . . , Xg, y-\ , y 2 , ... , 1/7 replacing our usual pseudo- 
alphabetic order, the labeling algorithm produces the labels shown below. 


S : (*, +, 00 ) 

3/6 : Oe, 

x 3 : (S, +, 1) 

*1 : (1/6, 

X5 : (S,+,l) 

xjx : Oi, 

1/4: (>3,+, 1) 

yi : Oi, 

3/5 : 03,+, 1) 

3/3 : Oi, 

x 6 '■ (l/4, — , 1) 

x 2 : (3/1, 

x 4 : (1/5, — , 1) 

T ■ (1J2, 


+/ 1) 
- 1 ) 
+/ 1 ) 
+/ 1 ) 
+, 1 ) 
- 1 ) 
+/ 1 ) 


This leads us to the augmenting path S, X 3 , 1 / 4 , xg, t/g , x\, yi, T, which gives us the flow 
shown in Figure 14.6. 
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Figure 14.6: The augmented flow 


Is this a maximum flow? Another run of the labeling algorithm produces 


S : 

(*, +,°°) 

X 4 : 

(V5,~A) 

x 5 : 

(s,+,i) 

3/4 : 

(x 4 ,+,l) 

3/5 : 

(*5,+/l) 

x 3 : 

( 1 / 4 , -,1) 


and then halts. Thus, the flow in Figure 14.6 is a maximum flow. 

Now that we know we have a maximum flow, we'd like to be able to argue that the 
matching we've found is also maximum. After all, the boss isn't going to be happy if 
he later finds out that this fancy algorithm you claimed gave an optimal assignment of 
jobs to workers left the fifth worker (X 5 ) without a job when all six of them could have 
been put to work. Let's take a look at which vertices were labeled by the Ford-Fulkerson 
labeling algorithm on the last run. There were three vertices (X3, x 4 , and X5) from V] 
labeled, while there were only two vertices ( 1/4 and t/5) from V 2 labeled. Notice that 1/4 
and t/5 are the only vertices that are neighbors of X3, X4, or X5 in G. Thus, no matter 
how we choose the matching edges from {*3, x 4 , X5}, one of these vertices will be left 
unsaturated. Therefore, one of the workers must go without a job assignment. (In our 
example, it's the fifth, but it's possible to choose different edges for the matching so 
another one of them is left without a task.) 

The phenomenon we've just observed is not unique to our example. In fact, in every 
bipartite graph G = (V,E) with V = V\ U V 2 in which we cannot find a matching that 
saturates all the vertices of V , we will find a similar configuration. This is a famous 
theorem of Hall, which we state below. 


Theorem 14.7 (Hall's Theorem). Let G = {V, E) be a bipartite graph ivith V = V\ U V 2 . 
There is a matching zvhich saturates all vertices ofV 1 if and only if for every subset A c V\, 
the set N c V of neighbors of the vertices in A satisfies \N\ > |A|. 
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14.3 Chain partitioning 

In Chapter 6, we discussed Dilworth's Theorem, which told us that for any poset P of 
width iv, there is a partition of P into w, but no fewer, chains. However, we were only 
able to devise an algorithm to find this chain partition (and a maximum antichain) in 
the special case where P was an interval order. Now, through the magic of network 
flows, we will be able to devise an efficient algorithm that works in general for all 
posets. However, to do so, we will require a slightly more complicated network than 
we devised in the previous section. 

Suppose that the points of our poset P are {x\ , x 2 , • • ■ , x„}. We construct a network 
from P consisting of the source S, sink T, and two points x' and x" for each point x; 
of P. All edges in our network will have capacity 1. We add edges from S to x' for 
1 < i < n and from x" to T for 1 < i < n. Of course, this network wouldn't be too 
useful, as it has no edges from the single-prime nodes to the double-prime nodes. To 
resolve this, we add an edge directed from x' to x" if and only if x; < Xy in P. 

Our running example in this section will be the poset in Figure 14.8(a). We'll discuss 
the points of the poset as x, where i is the number printed next to the point in the 
diagram. 


T 



S 


(a) A small poset (b) The associated network 

Figure 14 . 8 : A partially ordered set 14.8(a) and the associated network 14.8(b). 
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T 



S 

Figure 14 . 9 : An initial flow 


The first step is to create the network, which we show in Figure 14.8(b). In this net- 
work, all capacities are 1 , edges are directed from bottom to top, the first row of ten 
vertices is the x' arranged consecutively with x( at the left and x' w at the right, and 
the second row of ten vertices is the x" in increasing order of index. To see how this 
network is constructed, notice that x\ < xj in the poset, so we have the directed edge 
(x' , x"). Similarly, X4 is less than X3, X5, and X9 in the poset, leading to three directed 
edges leaving x' 4 in the network. As a third example, since X 9 is maximal in the poset, 
there are no directed edges leaving x' 9 . 


We have not yet seen how we might turn a maximum flow (or minimum cut) in 
the network we've just constructed into a minimum chain partition or a maximum an- 
tichain. It will be easier to see how this works once we have a confirmed maximum 
flow. Rather than running the labeling algorithm starting from the zero flow, we eye- 
ball a flow, such as the one shown in Figure 14.9. (Again, we use the convention that 
thick edges are full, while thin edges are empty.) 


When we run the labeling algorithm (using priority S, T, x' , . . . , x( Q , x", . . . , x" Q ), we 
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obtain the following list of labels: 


s 

(*,+,oo) 

x” 

( x' 5 , +, 1) 

x' 3 : (S, +, 1) 

x 3 

(S,+,l) 

x'l 

(Xg,+, 1) 

x ] : (Xy, +, 1) 

x 5 

(S,+,1) 

x 5 


x 2 : (X 7 , +, 1) 

X 6 

(S,+,1) 

x'l 

(x",-,l) 

Xj : (X 7 , +, 1) 

x' 9 

(S,+,1) 

Y‘ f 
Xg 

1) 

T: (x",+,l) 

x 3 

{x' 5 , +, 1) 

Xy 

(x'l, -A) 



Thus, we find the augmenting path (S, x' , x", x' 7 , x", T), and the updated flow can be 
seen in Figure 14.10. 


T 



S 

Figure 14 . 10 : A better flow 


If we run the labeling algorithm again, the algorithm assigns the labels below, leav- 
ing the sink unlabeled. 

S: (*,+,oo) x' 5 : (S,+, 1) x" : (x' 5 ,+,l) x\: (x" , -, 1) 

x' 3 : (S, +, 1) x' 9 : (S,+, 1) x" : (x',+,1) x' 8 : (x", -,1) 

In Figure 14.10, the black vertices are those the labeled in the final run, while the gold 
vertices are the unlabeled vertices. 

Now that we've gone over the part you already knew how to do, we need to discuss 
how to translate this network flow and cut into a chain partition and an antichain. If 
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there is a unit of flow on an edge (xj, xj'), then a good first instinct is to place x, and 
Xj in the same chain of a chain partition. To be able to do this successfully, of course, 
we need to ensure that this won't result in two incomparable points being placed in a 
chain. A way to see that everything works as desired is to think of starting with (xj, x") 
and then looking for flow leaving xj.. If there is, it goes to a vertex xj', so we may add 
Xk to the chain since x, < x; < x/ c . Continue in this manner until reaching a vertex in 
the network that does not have any flow leaving it. Then see if xj' has flow coming into 
it. If it does, it's from a vertex x' m that can be added since x m < x, < X;. 

Let's see how following this process for the flow in Figure 14.10 leads to a chain 
partition. If we start with x' v we see that (xj, xj') is full, so we place xi and X3 in chain 
Ci. Since xj has no flow leaving it, there are no greater elements to add to the chain. 
However, xj' has flow in from xj, so we add X2 to Ci. We now see that xj' has flow in 
from xj, so now Ci = {xi, X2, X3, X7}. Vertex xj' has no flow into it, so the building of 
the first chain stops. The first vertex we haven't placed into a chain is X4, so we note 
that (xj, x") is full, placing X4 and X5 in chain C2. We then look from xj and see no 
flow leaving. However, there is flow into xj' from xj, so Xg is added to C2. There is no 
flow out of xj', so C2 = {X4, X5, Xs}. Now the first point not in a chain is xg, so we use 
the flow from xj to x" to place Xg and X9 in chain C3. Again, no flow out of xj, so we 
look to xj', which is receiving flow from xjj,. Adding xio to C3 gives C3 = {xg, X9, X10}, 
and since every point is now in a chain, we may stop. 

Even once we see that the above process does in fact generate a chain partition, it is 
not immediately clear that it's a minimum chain partition. For this, we need to find 
an antichain of as many points as there are chains in our partition. (In the example 
we've been using, we need to find a three-element antichain.) This is where tracking 
the labeled vertices comes in handy. Suppose we have determined a chain C = (xi < 
X2 < • • • < Xk} using the network flow. Since xi is the minimal element of this chain, 
there is no flow into xj' and hence no flow out of xj'. Since T is unlabeled, this must 
mean that xj' is unlabeled. Similarly, Xk is the maximal element of C, so there is no 
flow out of xj. Thus, xj is labeled. Now considering the sequence of vertices 


x k’ x k' x k-l' x k-V 


, %2/ %2 r 


X 


// 

1 ' 


there must be a place where the vertices switch from being labeled to unlabeled. This 
must happen with xj labeled and xj' unlabeled. To see why, suppose that xj and xj' are 
both unlabeled while x' +1 and xj' +1 are both labeled. Because x, and x; + i are consecu- 
tive in C, there is flow on (xj, xjj hl ). Therefore, when scanning from xj' +| , the vertex xj 
would be labeled. For each chain of the chain partition, we then take the first element 
y for which y' is labeled and y" is unlabeled to form an antichain A = {y 1, . . . , y i:[ , }■ 
To see that A is an antichain, notice that if y, < y j, then (yj, y") is an edge in the net- 
work. Therefore, the scan from yj would label y". Using this process, we find that a 
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maximum antichain in our example is {x\, X 5 , xg}- 


14.4 Exercises 

1 . Use the techniques of this chapter to find a maximum matching from V\ to V 2 in 
the graph shown in Figure 14.11. The vertices on the bottom are the set V\, while the 
vertices on the top are the set V 2 . If you cannot find a matching that saturates all of the 
vertices in V\, explain why. 



Figure 14.11: Is there a matching saturating Vi? 


2. Use the techniques of this chapter to find a maximum matching from V\ to V 2 in 
the graph shown in Figure 14.12. The vertices on the bottom are the set V\, while the 
vertices on the top are the set V 2 ■ If you cannot find a matching that saturates all of the 
vertices in V\, explain why. 



Figure 14.12: Is there a matching saturating V \ ? 


3. Students are preparing to do final projects for an applied combinatorics course. 
The five possible topics for their final projects are graph algorithms, posets, induction, 
graph theory, and generating functions. There are five students in the class, and they 
have each given their professor the list of topics on which they are willing to do their 
project. Alice is interested in posets or graphs. Bob would be willing to do his project 
on graph algorithms, posets, or induction. Carlos will only consider posets or graphs. 
Dave likes generating functions and induction. Yolanda wants to do her project on ei- 
ther graphs or posets. To prevent unauthorized collaboration, the professor does not 
want to have two students work on the same topic. Is it possible to assign each stu- 
dent a topic from the lists above so that no two students work on the same project? If 
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so, find such an assignment. If not, find an assignment that maximizes the number of 
students who have assignments from their lists and explain why you cannot satisfy all 
the students' requests. 

4 . Seven colleges and universities are competing to recruit six high school football 
players to play for their varsity teams. Each school is only allowed to sign one more 
player, and each player is only allowed to commit to a single school. The table below 
lists the seven institutions and the students they are trying to recruit, have been admit- 
ted, and are also interested in playing for that school. (There's no point in assigning 
a school a player who cannot meet academic requirements or doesn't want to be part 
of that team.) The players are identified by the integers 1 through 6. Find a way of 
assigning the players to the schools that maximizes the number of schools who sign 
one of the six players. 


School 
Boston College 
Clemson University 
Georgia Institute of Technology 
University of Georgia 
University of Maryland 
University of North Carolina 
Virginia Polytechnic Institute and State University 


Player numbers 
1, 3,4 

1, 3, 4, 6 
2,6 

None interested 

2, 3,5 
U 2,5 

U 2, 5, 6 


5 . The questions in this exercise refer to the network diagram in Figure 14.13. This 
network corresponds to a poset P. As usual, all capacities are assumed to be 1, and all 
edges are directed upward. Answer the following questions about P ivithout drazuing 
the diagram of the poset. 

(a) Which element(s) are greater than x\ in P? 

(b) Which element(s) are less than X 5 in P? 

(c) Which element(s) are comparable with X(, in P? 

(d) List the maximal elements of P. 

(e) List the minimal elements of P. 
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T 



Figure 14.13: The network corresponding to a poset 


6. Draw the diagram of the poset that corresponds to the network in Figure 14.13. 

7. Use the methods developed in this chapter to find the width w of the poset corre- 
sponding to the network in Figure 14.13. Also find an antichain of size w and a partition 
into w chains. 


8. In Figure 14.14 we show a poset P and a network used to find a chain partition of 
P. (All edges in the network have a capacity of 1 and are directed from bottom to top. 
The bold edges currently carry a flow of 1.) Using the network, find the width w of P, 
a partition of P into w chains, and an antichain with w elements. 



Figure 14.14: A poset and the corresponding network diagram 


9. Draw the network corresponding to the poset P shown in Figure 14.15. Use the 
network to find the width w of P, a partition into w chains, and an antichain of size w. 
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Figure 14 . 15 : A poset 
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CHAPTER 

Polya's Enumeration Theorem 

In this chapter, we introduce a powerful enumeration technique generally referred to 
as Polya's enumeration theorem 1 . Polya's approach to counting allows us to use sym- 
metries (such as those of geometric objects like polygons) to form generating functions. 
These generating functions can then be used to answer combinatorial questions such 
as 

1. How many different necklaces of six beads can be formed using red, blue and 
green beads? What about 500-bead necklaces? 

2. How many musical scales consisting of 6 notes are there? 

3. How many isomers of the compound xylenol, C 6 H 3 (CH 3 ) 2 (OH), are there? What 
about C, ! H 2 )! + 2 ? (In chemistry, isomers are chemical compounds with the same 
number of molecules of each element but with different arrangements of those 
molecules.) 

4. How many nonisomorphic graphs are there on four vertices? How many of them 
have three edges? What about on 1000 vertices with 257, 000 edges? How many 
r - regular graphs are there on 40 vertices? (A graph is /'-regular if every vertex 
has degree r.) 

To use Polya's techniques, we will require the idea of a permutation group. How- 
ever, our treatment will be self-contained and driven by examples. We begin with a 
simplified version of the first question above. 


1 Like so many results of mathematics, the crux of the result was originally discovered by someone other 
than the mathematician whose name is associated with it. J.H. Redfield published this result in 1927, 10 
years prior to Polya's work. It would take until 1960 for Redfield's work to be discovered, by which time 
Polya's name was firmly attached to the technique. 
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15.1 Coloring the Vertices of a Square 

Let's begin by coloring the vertices of a square using white and gold. If we fix the po- 
sition of the square in the plane, there are 2 4 = 16 different colorings. These colorings 
are shown in Figure 15.1. 











Figure 15.1: The 16 colorings of the vertices of a square. 


However, if we think of the square as a metal frame with a white bead or a gold bead 
at each corner and allow the frame to be rotated and flipped over, we realize that many 
of these colorings are equivalent. For instance, if we flip coloring C 7 over about the 
vertical line dividing the square in half, we obtain coloring Cg. If we rotate coloring 
C 2 clockwise by 90°, we obtain coloring C 3 . In many cases, we want to consider such 
equivalent colorings as a single coloring. (Recall our motivating example of necklaces 
made of colored beads. It makes little sense to differentiate between two necklaces if 
one can be rotated and flipped to become the other.) 

To systematically determine how many of the colorings shown in Figure 15.1 are not 
equivalent, we must think about the transformations we can apply to the square and 
what each does to the colorings. Before examining the transformations' effects on the 
colorings, let's take a moment to see how they rearrange the vertices. To do this, we 
consider the upper-left vertex to be 1 , the upper-right vertex to be 2 , the lower-right 
vertex to be 3, and the lower-left vertex to be 4. We denote the clockwise rotation by 
90° by r\ and see that ri sends the vertex in position 1 to position 2, the vertex in po- 
sition 2 to position 3, the vertex in position 3 to position 4, and the vertex in position 
4 to position 1. For brevity, we will write r\ (1 ) = 2, r\ (2) = 3, etc. We can also rotate 
the square clockwise by 180° and denote that rotation by 7 - 2 - In this case, we find that 
7 * 2 ( 1 ) = 3, 7*2(2) = 4, 7*2(3) = 1, and 7*2(4) = 2. Notice that we can achieve the transforma- 
tion 7-2 by doing 7'i twice in succession. Furthermore, the clockwise rotation by 270°, 7 - 3 , 
can be achieved by doing ri three times in succession. (Counterclockwise rotations can 
be avoided by noting that they have the same effect as a clockwise rotation, although 
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by a different angle.) 

When it comes to flipping the square, there are four axes about which we can flip it: 
vertical, horizontal, positive-slope diagonal, and negative-slope diagonal. We denote 
these flips by v, h, p, and n, respectively. Now notice that u(l) = 2, v(2) = 1, v(3) = 4, 
and v(4) = 3. For the flip about the horizontal axis, we have /;( 1) = 4, h(2) = 3, h(3) = 2, 
and h( 4) = 1. For p, we have p{ 1) = 3, p{ 2) = 2, p( 3) = 1, and p( 4) = 4. Finally, for n 
we find n( 1) = 1, n(2) = 4, «(3) = 3, and m( 4) = 2. There is one more transformation 
that we must mention; the transformation that does nothing to the square is called the 
identity transformation, denoted t. It has i(l) = 1, i( 2) = 2, i(3) = 3, and i(4) = 4. 

Now that we've identified the eight transformations of the square, let's make a table 
showing which colorings from Figure 15.1 are left unchanged by the application of 
each transformation. Not surprisingly, the identity transformation leaves all of the 
colorings unchanged. Because r\ moves the vertices cyclically, we see that only C i and 
Ci6 remain unchanged when it is applied. Any coloring with more than one color 
would have a vertex of one color moved to one of the other color. Let's consider which 
colorings are fixed by v, the flip about the vertical axis. For this to happen, the color at 
position 1 must be the same as the color at position 2, and the color at position 3 must 
be the same as the color at position 4. Thus, we would expect to find 2-2 = 4 colorings 
unchanged by v. Examining Figure 15.1, we see that these colorings are C\, Cg, Cg, 
and C Performing a similar analysis for the remaining five transformations leads to 
Table 15.2. 


Transformation Fixed colorings 
t All 16 

r\ Ci, Ci6 

7*2 Cl, Cio, Cii, Ci6 

T 3 Cl, Ci6 

v Ci, Cs, Cg, Ci6 

h Ci, C7, C9, Ci6 

P Ci, C3, C5, Cio, Cn, C13, C15, Ci6 

n Ci, C2, C 4, Cio, Cn, C12, C14, Ci6 

Table 15 . 2 : Colorings fixed by transformations of the square 


At this point, it's natural to ask where this is going. After all, we're trying to count 
the number of nonequivalent colorings, and Table 15.2 makes no effort to group col- 
orings based on how a transformation changes one coloring to another. It turns out 
that there is a useful connection between counting the nonequivalent colorings and 
determining the number of colorings fixed by each transformation. To develop this 
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connection, we first need to discuss the equivalence relation created by the action of 
the transformations of the square on the set C of all 2 -colorings of the square. (Refer 
to Section B .13 for a refresher on the definition of equivalence relation.) To do this, no- 
tice that applying a transformation to a square with colored vertices results in another 
square with colored vertices. For instance, applying the transformation r\ to a square 
colored as in Cn results in a square colored as in C13. We say that the transformations 
of the square act on the set C of colorings. We denote this action by adding a star to 
the transformation name. For instance, r*(C 12) = C13 and rh(Cio) = Cn. 

If x is a transformation of the square with x*(C,) = Cj, then we say colorings C, and 
Cj are equivalent and write C, ~ Cj. Since T(C) = C for all C e C, ~ is reflexive. If 
t J(C;) = Cj and T* 2 (Cj) = C)t, then = C*, so ~ is transitive. To complete our 

verification that ~ is an equivalence relation, we must establish that it is symmetric. 
For this, we require the notion of the inverse of a transformation x, which is simply 
the transformation x -1 that undoes whatever x did. For instance, the inverse of t'\ is 
the counterclockwise rotation by 90 °, which has the same effect on the location of the 
vertices as 73. If x*(C/) = Cj, then x -1 *(Cy) = C,, so ~ is symmetric. 

Before proceeding to establish the connection between the number of nonequiva- 
lent colorings (equivalence classes under ~) and the number of colorings fixed by a 
transformation in full generality, let's see how it looks for our example. In looking at 
Figure 15 . 1 , you should notice that ~ partitions C into six equivalence classes. Two 
contain one coloring each (the all white and all gold colorings). One contains two col- 
orings (C10 and Cn). Finally, three contain four colorings each (one gold vertex, one 
white vertex, and the remaining four with two vertices of each color). Now look again 
at Table 15.2 and add up the number of colorings fixed by each transformation. In do- 
ing this, we obtain 48 , and when 48 is divided by the number of transformations (8), 
we get 6 (the number of equivalence classes)! It turns out that this is far from a fluke, 
as we will soon see. First, however, we introduce the concept of a permutation group 
to generalize our set of transformations of the square. 


15.2 Permutation Groups 

Entire books have been written on the theory of the mathematical structures known as 
groups. However, our study of Polya's enumeration theorem requires only a few facts 
about a particular class of groups that we introduce in this section. First, recall that a 
bijection from a set X to itself is called a permutation. A permutation group is a set P 
of permutations of a set X so that 

1 . the identity permutation 1 is in P; 

2 . if m, 7 i 2 e P, then 712 o tti e P; and 
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3. if 7i i e P, then n 1 1 e P. 

For our purposes, X will always be finite and we will usually take X = [n ] for some 
positive integer n. The symmetric group on n elements, denoted S„, is the set of all 
permutations of [n]. Every finite permutation group (and more generally every finite 
group) is a subgroup of S„ for some positive integer n. 

As our first example of a permutation group, consider the set of permutations we 
discussed in Section 15.1, called the dihedral group of the square. We will denote 
this group by Dg . We denote by Eh,, the similar group of transformations for a regular 
n-gon, using In as the subscript because there are In permutations in this group . 1 
The first criterion to be a permutation group is clearly satisfied by Ds ■ Verifying the 
other two is quite tedious, so we only present a couple of examples. First, notice that 
r 2 o n = r 3 - This can be determined by carrying out the composition of these functions 
as permutations or by noting that rotating 90° clockwise and then 180° clockwise is the 
same as rotating 270° clockwise. For v or, we find v o r(l) = 1, v o r(3) = 3, v o r(2) = 4, 
and v o r( 4) = 2, so v o r = n. For inverses, we have already discussed that rj " 1 = r 3 . 
Also, v~ l - v, and more generally, the inverse of any flip is that same flip. 


15.2.1 Representing permutations 

The way a permutation rearranges the elements of X is central to Polya's enumeration 
theorem. A proper choice of representation for a permutation is very important here, 
so let's discuss how permutations can be represented. One way to represent a permu- 
tation 7i of [n] is as a 2 X n matrix in which the first row represents the domain and the 
second row represents 71 by putting 71 (f) in position i. For example, 

/I 2 3 4 5\ 

71 \2 4 3 5 l) 

is the permutation of [5] with 7r(l) = 2, 7i(2) = 4, 7t( 3) = 3, tt( 4) = 5, and 7i(5) = 1. This 
notation is rather awkward and provides only the most basic information about the 
permutation. A more compact (and more useful for our purposes) notation is known 
as cycle notation. One way to visualize how the cycle notation is constructed is by 
constructing a digraph from a permutation 71 of [n]. The digraph has [ 7 ;] as its vertex 
set and a directed edge from i to j if and only if 71 (f) = j . (Here we allow a directed 
edge from a vertex to itself if 71 (f) = f.) The digraph corresponding to the permutation 
71 from above is shown in Figure 15.3. 


1 Some authors and computer algebra systems use D n as the notation for the dihedral group of the n-gon. 
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Figure 15.3: The digraph corresponding to permutation n = (1245)(3) 


Since n is a permutation, every component of such a digraph is a directed cycle. 
We can then use these cycles to write down the permutation in a compact manner. 
For each cycle, we start at the vertex with smallest label and go around the cycle in 
the direction of the edges, writing down the vertices' labels in order. We place this 
sequence of integers in parentheses. For the 4-cycle in Figure 15.3, we thus obtain 
(1245). (If n > 10, we place spaces or commas between the integers.) The component 
with a single vertex is denoted simply as (3), and thus we may write n = (1245)(3). By 
convention, the disjoint cycles of a permutation are listed so that their first entries are 
in increasing order. 

Example 15.4. The permutation n = (1483)(27)(56) has 7x(l) = 4, 7i(8) = 3, 7t( 3) = 1, 
and n(5) = 6. The permutation n' = (13)(2)(478)(56) has 7x'(l) = 3, 7x'(2) = 2, and 
Tt'(8) = 4. We say that n consists of two cycles of length 2 and one cycle of length 4. 
For 7t', we have one cycle of length 1, two cycles of length 2, and one cycle of length 3. 
A cycle of length k will also called a A: -cycle in this chapter. 

15.2.2 Multiplying permutations 

Because the operation in an arbitrary group is frequently called multiplication, it is 
common to refer to the composition of permutations as multiplication and write 7 x 27 x 4 
instead of 712 ° 7 x 4 . The important thing to remember here, however, is that the operation 
is simply function composition. Let's see a couple of examples. 

Example 15.5. Let Hi = (1234) and 7T2 = (12)(34). (Notice that these are the permu- 
tations ri and v , respectively, from D$.) Let 7 x 3 = 7 x 27 x 4 . To determine 7 x 3 , we start by 
finding 7 x 3 ( 1 ) = 7X27Xi(1) = 7 x 2 ( 2 ) = 1. We next find that 7 x 3 ( 2 ) = 7X27Xi( 2) = 7X2(3) = 4. 
Similarly, 7 x 3 ( 3 ) = 3 and 7 x 3 ( 4 ) = 2. Thus, 7 x 3 = (1)(24)(3), which we called n earlier. 

Now let 7 x 4 = 7 x 1 7X2- Then 7 x 4 ( 1 ) = 3, 7 x 4 ( 2 ) = 2, 7 x 4 ( 3 ) = 1, and 7 x 4 ( 4 ) = 4. Therefore, 
7 x 4 = (13)(2)(4), which we called p earlier. It's important to note that 7 x 47 x 2 + 7 x 27 x 4 , 
which hopefully does not surprise you, since function composition is not in general 
commutative. To further illustrate the lack of commutativity in permutation groups. 
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pick up a book (Not this one! You need to keep reading directions here.) so that cover 
is up and the spine is to the left. First, flip the book over from left to right. Then rotate 
it 90° clockwise. Where is the spine? Now return the book to the cover-up, spine-left 
position. Rotate the book 90° clockwise and then flip it over from left to right. Where 
is the spine this time? 

It quickly gets tedious to write down where the product of two (or more) permu- 
tations sends each element. A more efficient approach would be to draw the digraph 
and then write down the cycle structure. With some practice, however, you can build 
the cycle notation as you go along, as we demonstrate in the following example. 

Example 15.6. Let 7ii = (123)(487)(5)(6) and ng = (18765)(234). Let n 3 = Ti 2 n\. To 
start constructing the cycle notation for 7T3, we must determine where 7T3 sends 1. We 
find that it sends it to 3, since 7ii sends 1 to 2 and 712 sends 2 to 3. Thus, the first cycle 
begins 13. Now where is 3 sent? It's sent to 8, which goes to 6, which goes to 5, which 
goes to 1, completing our first cycle as (13865). The first integer not in this cycle is 2, 
which we use to start our next cycle. We find that 2 is sent to 4, which is set to 7, which 
is set to 2. Thus, the second cycle is (247). Now all elements of 8 are represented in 
these cycles, so we know that 7T3 = (13865)(247). 

We conclude this section with one more example. 

Example 15.7. Let's find [(123456)] [(165432)], where we've written the two permuta- 
tions being multiplied inside brackets. Since we work from right to left, we find that 
the first permutation applied sends 1 to 6, and the second sends 6 to 1, so our first cycle 
is (1). Next, we find that the product sends 2 to 2. It also sends i to i for every other 
i < 6. Thus, the product is (1)(2)(3)(4)(5)(6), which is better known as the identity 
permutation. Thus, (123456) and (165432) are inverses. 

In the next section, we will use standard counting techniques we've seen before in 
this book to prove results about groups acting ons ets. We will state the results for 
arbitrary groups, but you may safely replace "group" by "permutation group" without 
losing any understanding required for the remainder of the chapter. 


15.3 Burnside’s Lemma 

Burnside's lemma 1 relates the number of equivalence classes of the action of a group 
on a finite set to the number of elements of the set fixed by the elements of the group. 
Before stating and proving it, we need some notation and a proposition. If a group 

1 Again, not originally proved by Burnside. It was known to Frobenius and for the most part by Cauchy. 
However, it was most easily found in Burnside's book, and thus his name came to be attached. 
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G acts on a finite set C, let ~ be the equivalence relation induced by this action. (As 
before, the action of n e G on C will be denoted n*.) Denote the equivalence class 
containing C e C by (C) . For n e G, let fixc(7i) = {C e C : 7t*(C) = C}, the set of 
colorings fixed by n. For C e C, let stabc(C) = {ti e G: n(C) = C} be the stabilizer of 
C in G, the permutations in G that fix C. 

To illustrate these concepts before applying them, refer back to Table 15.2. Using 
that information, we can determine that fixc(r 2 ) = { C\ , Cm, Cn , Cu,}. Determining 
the stabilizer of a coloring requires finding the rows of the table in which it appears. 
Thus, stabo 8 (C 7 ) = {(,/;} and stabD 8 (Cn) = {i,r 2 ,p ,n}. 

Proposition 15.8. Let a group G act on a finite set C. Then for all CeC, 

I stab G (C')| = |G|. 

C'6(C> 

Proof. Let stabG(C) = {n\, ..., 7ijt} and T(C, C') = {n e G: 7t*(C) = C'}. (Note that 
T(C, C) = stabc(C).) Take n e T(C, C')- Then no m £ T(C, C') for 1 < i < k. Further- 
more, if n ° 7T; = 7T o 7i,, then n~ l o n o m = 7T _1 o 7t ° 7i ;. Thus 7i; = nj and z = j . 
If n' e T(C, C'), then 7i _1 o n' e T(C, C). Thus, n -1 o n' = ni for some z, and hence 
n' = n o 71;. Therefore T(C, C') = {n o 711 , . . . , n ° 7i ^} . Additionally, we observe that 
T(C', C) = { 7i - 1 : n e T(C, C')}. Now for all C' e (C), 

| stab g(C') | = |T(C',C')| = |T(C',C)| = |T(C,C')| = |T(C, C)| = |stab G (C)|. 

Therefore, 

J] | stab G (C')| = J] |T(C,C')|. 

C'e(C> C'e(C> 

Now notice that each element of G appears in T(C, C') for precisely one C' e (C), and 
the proposition follows. □ 

With Proposition 15.8 established, we are now prepared for Burnside's lemma. 

Lemma 15.9 (Burnside's Lemma). Let a group G act on a finite set C. If N is the number 
of equivalence classes ofC induced by this action, then 

N = jkiJh l fix c( n )l- 

' ' neG 

Before we proceed to the proof, note that the calculation in Burnside's lemma for the 
example of 2-coloring the vertices of a square is exactly the calculation we performed 
at the end of Section 15.1. 
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Proof. Let X = {(7t,C) e GxC: 7i(C) = C}. Notice that £ neG |fixc(n)| = |X|, since 
each term in the sum counts how many ordered pairs of X have n in their first coor- 
dinate. Similarly, Xcec I stabc(C)| = |X|, with each term of this sum counting how 
many ordered pairs of X have C as their second coordinate. Thus, X~eG |fix c (n)| = 
Xcec I stabG(C)|. Now note that the latter sum may be rewritten as 

Y ( Y i st ab G (c')i 

equivalence \C'e(C) 
classes (C) 

By Proposition 15.8, the inner sum is |G|. Therefore, the total sum is N ■ |G|, so solving 
for N gives the desired equation. □ 

Burnside's lemma helpfully validates the computations we did in the previous sec- 
tion. However, what if instead of a square we were working with a hexagon and in- 
stead of two colors we allowed four? Then there would be 4 6 = 4096 different colorings 
and the dihedral group of the hexagon has 12 elements. Assembling the analogue of 
Table 15.2 in this situation would be a nightmare! This is where the genius of Polya's 
approach comes into play, as we see in the next section. 


15.4 Polya’s Theorem 

Before getting to the full version of Polya's formula, we must develop a generating 
function as promised at the beginning of the chapter. To do this, we will return to our 
example of Section 15.1. 

15.4.1 The cycle index 

Unlike the generating functions we encountered in Chapter 8, the generating functions 
we will develop in this chapter will have more than one variable. We begin by associ- 
ating a monomial with each element of the permutation group involved. In this case, 
it is T)g, the dihedral group of the square. To determine the monomial associated to a 
permutation, we need to write the permutation in cycle notation and then determine 
the monomial based on the number of cycles of each length. Specifically, if tc is a per- 
mutation of [n] with ji( cycles of length k for 1 < k < n, then the monomial associated 
to n is x^x ! 2 ■ ■ ■ x„ ■ Note that / i + 2/2 + 3/3 + ••■+«/„ = n. For example, the per- 
mutation r\ = (1234) is associated with the monomial x^ since it consists of a single 
cycle of length 4. The permutation r 2 = (13)(24) has two cycles of length 2, and thus 
its monomial is x^. For p = (14)(2)(3), we have two 1-cycles and one 2-cycle, yielding 
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the monomial x^x^. In Table 15.10, we show all eight permutations in D% along with 
their associated monomials. 


Transformation Monomial Fixed colorings 


i = (1)(2)(3)(4) 

x\ 

16 

n = (1234) 

x\ 

2 

r 2 = (13) (24) 

x\ 

4 

r 3 = (1432) 

x\ 

2 

z> = (12)(34) 

2 

4 

h = (14)(23) 

x\ 

4 

P = (14)(2)(3) 

x^x] 

8 

n = (1)(24)(3) 

2 1 

8 


Table 15 . 10 : Monomials arising from the dihedral group of the square 


Now let's see how the number of 2-colorings of the square fixed by a permutation 
can be determined from its cycle structure and associated monomial. If tt(z’) = j, then 
we know that for n to fix a coloring C, vertices i and j must be colored the same in C. 
Thus, the second vertex in a cycle must have the same color as the first. But then the 
third vertex must have the same color as the second, which is the same color as the first. 
In fact, all vertices appearing in a cycle of n must have the same color in C if n fixes 
C! Since we are coloring with the two colors white and gold, we can choose to color 
the points of each cycle uniformly white or gold. For example, for the permutation 
v = (12)(34) to fix a coloring of the square, vertices 1 and 2 must be colored the same 
color (2 choices) and vertices 3 and 4 must be colored the same color (2 choices). Thus, 
there are 2-2 = 4 colorings fixed by v. Since there are two choices for how to uniformly 
color the elements of a cycle, letting x, = 2 for all i in the monomial associated with tl 
gives the number of colorings fixed by n. In Table 15.10, the "Fixed colorings" column 
gives the number of 2-colorings of the square fixed by each permutation. Before, we 
obtained this manually by considering the action of Ds on the set of all 16 colorings. 
Now we only need the cycle notation and the monomials that result from it to derive 
this! 

Recall that Burnside's Lemma states that the number of colorings fixed by the action 
of a group can be obtained by adding up the number fixed by each permutation and 
dividing by the number of permutations in the group. If we do that instead for the 
monomials arising from the permutations in a permutation group G in which every 
cycle of every permutation has at most n entries, we obtain a polynomial known as the 
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cycle index Pg(x i, X2, • • • , x n )• For our running example, we find 

l 

Pd s ( x i, x 2, x 3r X4) = - (x\ + 2x?xi + 3x~ + 2 x 1 ) . 

8 

To find the number of distinct 2-colorings of the square, we thus let x; = 2 for all 
i and obtain Pd 8 ( 2, 2, 2, 2) = 6 as before. Notice, however, that we have something 
more powerful than Burnside's lemma here. We may substitute any positive integer m 
for each x, to find out how many nonequivalent ///-colorings of the square exist. We 
no longer have to analyze how many colorings each permutation fixes. For instance, 
Pd 8 ( 3 , 3, 3,3) = 21, meaning that 21 of the 81 colorings of the vertices of the square 
using three colors are distinct. 

15.4.2 The full enumeration formula 

Flopefully the power of the cycle index to count colorings that are distinct when sym- 
metries are considered is becoming apparent. In the next section, we will provide ad- 
ditional examples of how it can be used. Flowever, we still haven't seen the full power 
of Polya's technique. From the cycle index alone, we can determine how many color- 
ings of the vertices of the square are distinct. Flowever, what if we want to know how 
many of them have two white vertices and two gold vertices? This is where Polya's 
enumeration formula truly plays the role of a generating function. 

Let's again consider the cycle index for the dihedral group Dg: 

Pd s (x 1, X2, X3, X4) = - (xf + 2x?xl + 3x? + 2 x 1 ) . 

8 

Instead of substituting integers for the x;, let's consider what happens if we substitute 
something that allows us to track the colors used. Since x\ represents a cycle of length 
1 in a permutation, the choice of white or gold for the vertex in such a cycle amounts 
to a single vertex receiving that color. What happens if we substitute w + g for Xi? The 
first term in Pq 8 corresponds to the identity permutation 1 , which fixes all colorings of 
the square. Letting x\ = w + g in this term gives 

(w + y) 4 = y 4 + 4y 3 zv + 6y 2 zv 2 + Ayzv 3 + zv 4 , 

which tells us that / fixes one coloring with four gold vertices, four colorings with three 
gold vertices and one white vertex, six colorings with two gold vertices and two white 
vertices, four colorings with one gold vertex and three white vertices, and one coloring 
with four white vertices. 

Let's continue establishing a pattern here by considering the variable X2. It repre- 
sents the cycles of length 2 in a permutation. Such a cycle must be colored uniformly 
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white or gold to be fixed by the permutation. Thus, choosing white or gold for the 
vertices in that cycle results in two white vertices or two gold vertices in the coloring. 
Since this happens for every cycle of length 2, we want to substitute zv 2 + q 1 for %2 in 
the cycle index. The x 2 x j terms in Pd 8 are associated with the flips p and n . Letting 
x\ = zjo + g and xi = zv 2 + g 2 , we find 

x\x\ = g 4 + 2g 3 zv + 2g 2 zv 2 + 2 gzv 3 + zv 4 , 

from which we are able to deduce that p and n each fix one coloring with four gold 
vertices, two colorings with three gold vertices and one white vertex, and so on. Com- 
paring this with Table 15.2 shows that the generating function is right on. 

By now the pattern is becoming apparent. If we substitute zv 1 + g 1 for x, in the cycle 
index for each i, we then keep track of how many vertices are colored white and how 
many are colored gold. The simplification of the cycle index in this case is then a gen- 
erating function in which the coefficient on g s zv t is the number of distinct colorings 
of the vertices of the square with s vertices colored gold and t vertices colored white. 
Doing this and simplifying gives 

Pd 8 (zc + g, zv 2 + g 2 , zv 3 + g 3 , zv 4 + g 4 ) = g 4 + g 3 zv + 2 g 2 zv 2 + gzv 3 + zv 4 . 


From this we find one coloring with all vertices gold, one coloring with all vertices 
white, one coloring with three gold vertices and one white vertex, one coloring with 
one gold vertex and three white vertices, and two colorings with two vertices of each 
color. 

As with the other results we've discovered in this chapter, this property of the cycle 
index holds up beyond the case of coloring the vertices of the square with two colors. 
The full version is Polya's enumeration theorem: 

Theorem 15.11 (Polya's Enumeration Theorem). Let S be a set with |S| = r and C the set 
of colorings ofS using the colors c \, . . . , c m . If a permutation group G acts on S to induce an 
equivalence relation on C, then 






is the generating function for the number of nonequivalent colorings ofS in C. 

If we return to coloring the vertices of the square but now allow the color blue as 
well, we find 


Pd s (zv + g + b, zv 2 + g 2 + b 2 , zv 3 + g 3 + b 3 , zv 4 + g 4 + b 4 ) = b 4 + b 3 g + 2 b 2 g 2 
+ bg 3 + g 4 + b 3 zv + 2b 2 gzv + lbg 2 zv + g 3 zv + lb 2 zv 2 + 2b gzv 2 + 2g 2 zv 2 

+ bzv 3 + gzv 3 + zv 4 . 
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From this generating function, we can readily determine the number of nonequivalent 
colorings with two blue vertices, one gold vertex, and one white vertex to be 2. Be- 
cause the generating function of Polya's Enumeration Theorem records the number of 
nonequivalent patterns, it is sometimes called the pattern inventory. 

What if we were interested in making necklaces with 500 (very small) beads colored 
white, gold, and blue? This would be equivalent to coloring the vertices of a regular 
500-gon, and the dihedral group D iqoo would give the appropriate transformations. 
With a computer algebra system 1 such as Mathematica®, it is possible to quickly pro- 
duce the pattern inventory for such a problem. In doing so, we find that there are 

3636029179586993684238526707954331911802338502600162304034603583 
2580600191583895484198508262979388783308179702534404046627287796 
4304252714992703135653472347417085467453334179308247819807028526 
92187253642441292279756575936040804567103229 * 3.6 x 10 235 

possible necklaces. Of them, 

2529491842340460773490413186201010487791417294078808662803638965 
6782447138833704326875393229442323085905838200071479575905731776 
6605088026968640797415175535033372572682057214340157297357996 
345021733060 ~ 2.5 x 10 2 °° 

have 225 white beads, 225 gold beads, and 50 blue beads. 

The remainder of this chapter will focus on applications of Polya's Enumeration The- 
orem and the pattern inventory in a variety of settings. 


15.5 Applications of Polya’s Enumeration Formula 

This section explores a number of situations in which Polya's enumeration formula can 
be used. The applications are from a variety of domains and are arranged in increasing 
order of complexity, beginning with an example from music theory and concluding 
with counting nonisomorphic graphs. 

15.5.1 Counting musical scales 

Western music is generally based on a system of 12 equally-spaced notes. Although 
these notes are usually named by letters of the alphabet (with modifiers), for our pur- 

'With some more experience in group theory, it is possible to give a general formula for the cycle index of 
the dihedral group D2„, so the computer algebra system is a nice tool, but not required. 
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poses it will suffice to number them as 0, 1, . . . , 11. These notes are arranged into oc- 
taves so that the next pitch after 11 is again named 0 and the pitch before 0 is named 
11. For this reason, we may consider the system of notes to correspond to the integers 
modulo 12. With these definitions, a scale is a subset of {0, 1, . . . , 11} arranged in in- 
creasing order. A transposition of a scale is a uniform transformation that replaces 
each note x of the scale by x+a (mod 12) for some constant a. Musicians consider two 
scales to be equivalent if one is a transposition of the other. Since a scale is a subset, no 
regard is paid to which note starts the scale, either. The question we investigate in this 
section is "How many nonequivalent scales are there consisting of precisely k notes?" 

Because of the cyclic nature of the note names, we may consider arranging them in 
order clockwise around a circle. Selecting the notes for a scale then becomes a coloring 
problem if we say that selected notes are colored black and unselected notes are colored 
white. In Figure 15.12, we show three 5-note scales using this convention. Notice that 
since S 2 can be obtained from Si by rotating it forward seven positions. Si and S 2 are 
equivalent by the transposition of adding 7. However, S 3 is not equivalent to Si or S 2 , 
as it cannot be obtained from them by rotation. (Note that S 3 could be obtained from 
Si if we allowed flips in addition to rotations. Since the only operation allowed is the 
transposition, which corresponds to rotation, they are inequivalent.) 





Figure 15.12: Three scales depicted by coloring 


We have now mathematically modeled musical scales as discrete structures in a way 
that we can use Polya's Enumeration Theorem. What is the group acting on our black- 
/ white colorings of the vertices of a regular 12-gon? One permutation in the group is 
t = (0 123456789 10 11), which corresponds to the transposition by one note. In 
fact, every element of the group can be realized as some power of t since only rotations 
are allowed and t is the smallest possible rotation. Thus, the group acting on the col- 
orings is the cyclic group of order 12, denoted C 12 = {f, t, t 2 , . . . , t 11 }. Exercise 15.6.5 
asks you to write all the elements of this group in cycle notation. The best way to do 
this is by multiplying t !_1 by t (i.e., compute tt !_1 ) to find t. Once you've done this. 
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you will be able to easily verify that the cycle index is 


r 12 r 6 r 4 r 3 r 2 

D („ -v 'l - 1 2 , X 3 , X 4 , X 6 *12 

p c 12 (x i,...,x u ) ~u + 12 + J + J + J + ^- 


Since we've chosen colorings using black and white, it would make sense to substitute 
Xj = b‘ +w‘ for all i in Pc 12 now to find the number of k-note scales. However, there is a 
convenient shortcut we may take to make the resulting generating function look more 
like those to which we grew accustomed in Chapter 8. The information about how 
many notes are not included in our scale (the number colored white) can be deduced 
from the number that are included. Thus, we may eliminate the use of the variable w, 
replacing it by 1 . We now find 


P Cl2 (l + b, 1 + b 2 , . . . , 1 + b 12 ) = b 12 + b 11 + 6b 10 + 19b 9 + 43b 8 

+ 66 b 7 + 80b 6 + 66 b 5 + 43b 4 + 19b 3 + 6b 2 + b + 1. 


From this, we are able to deduce that the number of scales with k notes is the coefficient 
on b k . Therefore, the answer to our question at the beginning of the chapter about the 
number of 6-note scales is 80. 


15.5.2 Enumerating isomers 

Benzene is a chemical compound with formula meaning it consists of six carbon 

atoms and six hydrogen atoms. These atoms are bonded in such a way that the six 
carbon atoms form a hexagonal ring with alternating single and double bonds. A hy- 
drogen atom is bonded to each carbon atom (on the outside of the ring). From benzene 
it is possible to form other chemical compounds that are part of a family known as aro- 
matic hydrocarbons. These compounds are formed by replacing one or more of the 
hydrogen atoms by atoms of other elements or functional groups such as CH3 (methyl 
group) or OH (hydroxyl group). Because there are six choices for which hydrogen 
atoms to replace, molecules with the same chemical formula but different structures 
can be formed in this manner. Such molecules are called isomers. In this subsection, 
we will see how Polya's Enumeration Theorem can be used to determine the number 
of isomers of the aromatic hydrocarbon xylenol (also known as dimethylphenol). 

Before we get into the molecular structure of xylenol, we need to discuss the permu- 
tation group that will act on a benzene ring. Much like with our example of coloring 
the vertices of the square, we find that there are rotations and flips at play here. In 
fact, the group we require is the dihedral group of the hexagon, D12. If we number 
the six carbon atoms in clockwise order as 1, 2 , . . . , 6, then we find that the clockwise 
rotation by 60° corresponds to the permutation r = (123456). The other rotations are 
the higher powers of r, as shown in Table 15.13. The flip across the vertical axis is the 
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permutation / = (16)(25)(34). The remaining elements of Du (other than the identity 
i) can all be realized as some rotation followed by this flip. The full list of permutations 
is shown in Table 15.13, where each permutation is accompanied by the monomial it 
contributes to the cycle index. 


Permutation 

Monomial 

Permutation 

Monomial 

i = (1)(2)(3)(4)(5)(6) 

x\ 

/ = (16)(25)(34) 

x\ 

r = (123456) 

xj 

fr = (15)(24)(3)(6) 

2 2 
y*- y*- 

-A. -j A ^ 

r 2 = (135)(246) 

x l 

fr 2 = (14)(23) (56) 

X 3 

r 3 = (14)(25)(36) 

x\ 

fr 3 = (13)(2)(46)(5) 

x 2 x^ 

r 4 = (153)(264) 

x\ 

fr 4 = (12)(36)(45) 

X 2 

r 5 = (165432) 

x l 

fr 5 = (1)(26)(35)(4) 

x 2 x^ 


Table 15 . 13 : Cycle representation of permutations in Du 


With the monomials associated to the permutations in Du identified, we are able to 
write down the cycle index 

P Dl2 (*i, • • ■ , x 6 ) = — (*i + 2x\ + 2x 3 + 4x 2 + 3x i x i)- 

With the cycle index determined, we now turn our attention to using it to find the num- 
ber of isomers of xylenol. This aromatic hydrocarbon has three hydrogen molecules, 
two methyl groups, and a hydroxyl group attached to the carbon atoms. Recalling that 
hydrogen atoms are the default from benzene, we can more or less ignore them when 
choosing the appropriate substitution for the X; in the cycle index. If we let m denote 
methyl groups and h hydroxyl groups, we can then substitute x, =1 + in' + h' in P/) ]2 . 
This substitution gives the generating function 

1 + h + 3 h 2 + 3 h 3 + 3h 4 + h 5 + h 6 + m + 3 hm + 6 h 2 m + 6 h 3 m 

+ 3 h 4 m + h 5 m + 3 m 2 + 6 hm 2 + 11 h 2 m 2 + 6 h 3 m 2 + 3 h 4 m 2 + 3 m 3 + 6 hm 3 

+ 6 h 2 m 3 + 3 h 3 m 3 + 3m 4 + 3 hm 4 + 3 h 2 m 4 + m 5 + hm 5 + m 6 . 

Since xylenol has one hydroxyl group and two methyl groups, we are looking for the 
coefficient on hm 2 in this generating function. The coefficient is 6, so there are six 
isomers of xylenol. 

In his original paper, Polya used his techniques to enumerate the number of isomers 
of the alkanes C n li 2 n+ 2 - When modeled as graphs, these chemical compounds are 
special types of trees. Since that time, Polya's Enumeration Theorem has been used to 
enumerate isomers for many different chemical compounds. 
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15.5.3 Counting nonisomorphic graphs 

Counting the graphs with vertex set [n] is not difficult. There are C(n, 2) possible 
edges, each of which can be included or excluded. Thus, there are labeled 

graphs on n vertices. It's only a bit of extra thought to determine that if you only 
want to count the labeled graphs on n vertices with k edges, you simply must choose 
a /c-element subset of the set of all C(n, 2) possible edges. Thus, there are 

© 

k 


graphs with vertex set [ 7 ;] and exactly k edges. 

A more difficult problem arises when we want to start counting nonisomorphic graphs 
on n vertices. (One can think of these as unlabeled graphs as well.) For example, in 
Figure 15.14, we show four different labeled graphs on four vertices. The first three 
graphs shown there, however, are isomorphic to each other. Thus, only two noniso- 
morphic graphs on four vertices are illustrated in the figure. To account for isomor- 
phisms, we need to bring Polya's Enumeration Theorem into play. 



Figure 15.14: Four labeled graphs on four vertices 

We begin by considering all 2 C( -”' 2 ) graphs with vertex set [n] and choosing an ap- 
propriate permutation group to act in the situation. Since any vertex can be mapped 
to any other vertex, the symmetric group S 4 acts on the vertices. Flowever, we have 
to be careful about how we find the cycle index here. When we were working with 
colorings of the vertices of the square, we realized that all the vertices appearing in the 
same cycle of a permutation n had to be colored the same color. Since we're concerned 
with edges here and not vertex colorings, what we really need for a permutation to fix 
a graph is that every edge be sent to an edge and every non-edge be sent to a non-edge. 
To be specific, if {1, 2} is an edge of some G and n e S 4 fixes G, then { n(l ), 7 i( 2 )} must 
also be an edge of G. Similarly, if vertices 3 and 4 are not adjacent in G, then n(3) and 
n( 4) must also be nonadjacent in G. 

(2) 

To account for edges, we move from the symmetric group S 4 to its pair group . 

( 2 ) 

The objects that S t permutes are the 2-element subsets of {1, 2, 3, 4}. For ease of no- 
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tation, we will denote the 2-element subset { i, j} by en. To find the permutations in 
, we consider the vertex permutations in S 4 and see how they permute the e,/. The 
identity permutation 1 = (1)(2)(3)(4) of S 4 corresponds to the identity permutation 

1 = (ei 2 )(Ti 3 )(ei 4 )(e 23 )(e 24 )(e 34 ) of . Now let's consider the permutation (12)(3)(4). 
It fixes £42 since it sends 1 to 2 and 2 to 1. It also fixeds £34 by fixing 3 and 4. How- 
ever, it interchanges £13 with £23 (3 is fixed and 1 is swapped with 2 ) and £14 with 
£24 (1 is sent to 2 and 4 is fixed). Thus, the corresponding permutation of pairs is 

( £ 1 2 )( £| 3 £ 23 ) ( £ 1 4 £ 24 )( £ 34 ) ■ For another example, consider the permutation (123)(4). It 

( 2 ) 

corresponds to the permutation (£i 2 £ 23 e i 3 X e i 4 £ 24 e 34 ) in . 

( 2 ) 

Since we're only after the cycle index of , we don't need to find all 24 permuta- 
tions in the pair group. However, we do need to know the types of those permutations 
in terms of cycle lengths so we can associate the appropriate monomials. For the three 
examples we've considered, the cycle structure of the permutation in the pair group 
doesn't depend on the original permutation in S 4 other than for its cycle structure. Any 
permutation in S 4 consisting of a 2-cycle and two 1-cycles will correspond to a permu- 
tation with two 2-cycles and two 1-cycles in S ^ . A permutation in S 4 with one 3-cycle 
and one 1-cycle will correspond to a permutation with two 3-cycles in the pair group. 
By considering an example of a permutation in S 4 consisting of a single 4-cycle, we 
find that the corresponding permutation in the pair group has a 4-cycle and a 2-cycle. 
Finally, a permutation of S 4 consisting of two 2-cycles corresponds to a permutation 
in having two 2-cycles and two 1-cycles. (Exercise 15.6.8 asks you to verify these 
claims using specific permutations.) 

(2) 

Now that we know the cycle structure of the permutations in , the only task re- 
maining before we can find its cycle index of is to determine how many permutations 
have each of the possible cycle structures. For this, we again refer back to permuta- 
tions of the symmetric group S 4 . A permutation consisting of a single 4-cycle begins 
with 1 and then has 2, 3, and 4 in any of the 3! = 6 possible orders, so there are 6 such 
permutations. For permutations consisting of a 1-cycle and a 3-cycle, there are 4 ways 
to choose the element for the 1 -cycle and then 2 ways to arrange the other three as a 
3-cycle. (Remember the smallest of them must be placed first, so there are then 2 ways 
to arrange the remaining two.) Thus, there are 8 such permutations. For a permutation 
consisting of two 1-cycles and a 2-cycle, there are C(4, 2) = 6 ways to choose the two 
elements for the 2-cycle. Thus, there are 6 such permutations. For a permutation to 
consist of two 2-cycles, there are C( 4, 2) = 6 ways to choose two elements for the first 
2-cycle. The other two are then put in the second 2-cycle. However, this counts each 
permutation twice, once for when the first 2 -cycle is the chosen pair and once for when 
it is the "other two." Thus, there are 3 permutations consisting of two 2-cycles. Finally, 
only i consists of four 1 -cycles. 
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Now we're prepared to write down the cycle index of the pair group 

P s < 2 )(xi , . . . ,xs) = — (xj! + 9x\x\ + 8 X 3 + 6 x 2 X 4 ) . 

To use this to enumerate graphs, we can now make the substitution X; = 1 + x ! for 
1 < i < 6 . This allows us to account for the two options of an edge not being present 
or being present. In doing so, we find 

P q ( 2 )(l + x, . . . , 1 + x 6 ) = 1 + x + lx 2 + 3x 3 + 2x 4 + x 5 + x 6 

is the generating function for the number of 4-vertex graphs with m edges, 0 < m < 6. 
To find the total number of nonisomorphic graphs on four vertices, we substitute x = 1 
into this polynomial. This allows us to conclude there are 11 nonisomorphic graphs 
on four vertices, a marked reduction from the 64 labeled graphs. 

The techniques of this subsection can be used, given enough computing power, to 
find the number of nonisomorphic graphs on any number of vertices. For 30 vertices, 
there are 

334494316309257669249439569928080028956631479935393064329967834 

887217734534880582749030521599504384 « 3.3 x 10 98 

nonisomorphic graphs, as compared to 2 435 « 8.9 X 10 13 ° labeled graphs on 30 vertices. 
The number of nonisomorphic graphs with precisely 200 edges is 

313382480997072627625877247573364018544676703365501785583608267 

7050799699893512219821910360979601 ~ 3.1 x 10 % . 

The last part of the question about graph enumeration at the beginning of the chapter 
was about enumerating the graphs on some number of vertices in which every vertex 
has degree r. While this might seem like it could be approached using the techniques 
of this chapter, it turns out that it cannot because of the increased dependency between 
where vertices are mapped. 
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1 . Write the permutations shown below in cycle notation. 



1 

2 

3 

4 

5 

6\ 




Hi = 

\4 

2 

5 

6 

3 

1) 



7I 2 = 


(1 

2 

3 

4 

5 

6 

7 

8\ 


713 = 

\3 

1 

5 

8 

2 

6 

4 

7) 

714 = 


2 3 4 5 6\ 

6 1 3 4 2) 

2 3 4 5 6 7 8\ 

7 1 6 8 4 2 5/ 
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2. Compute 777772 , 772771 , 773774 , and 774773 for the permutations 77 ; in Exercise 15.6.1. 

3 . Find stab/^fCs) and stabo 8 (Ci6) for the colorings of the vertices of the square shown 
in Figure 15.1 by referring to Table 15.2. 

4 . In Figure 15.15, we show a regular pentagon with its vertices labeled. Use this la- 
beling to complete this exercise. 


1 



Figure 15 . 15 : A pentagon with labeled vertices 


(a) The dihedral group of the pentagon, Dio, contains 10 permutations. Let ri = 
(12345) be the clockwise rotation by 72° and f\ = (1)(25)(34) be the flip about the 
line passing through 1 and perpendicular to the opposite side. Let rj, r 3 , and 74 be 
the other rotations in Dio- Denote the flip about the line passing through vertex i 
and perpendicular to the other side by /;, 1 < i < 5. Write all 10 elements of Dio 
in cycle notation. 

(b) Suppose we are coloring the vertices of the pentagon using black and white. Draw 
the colorings fixed by ri. Draw the colorings fixed by f\. 

(c) Find stab/) ni (C) where C is the coloring of the vertices of the pentagon in which 
vertices 1, 2, and 5 are colored black and vertices 3 and 4 are colored white. 

(d) Find the cycle index of Dio- 

(e) Use the cycle index to determine the number of nonequivalent colorings of ver- 
tices of the pentagon using black and white. 

(f) Making an appropriate substitution for the x, in the cycle index, find the number 
of nonequivalent colorings of the vertices of the pentagon in which two vertices 
are colored black and three vertices are colored white. Draw these colorings. 

5 . Write all permutations in C 12 , the cyclic group of order 12, in cycle notation. 

6. The 12-note western scale is not the only system on which music is based. In clas- 
sical Thai music, a scale with seven equally-spaced notes per octave is used. As in 
western music, a scale is a subset of these seven notes, and two scales are equivalent 
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if they are transpositions of each other. Find the number of A: -note scales in classical 
Thai music for 1 < k <7. 

7 . Xylene is an aromatic hydrocarbon having two methyl groups (and four hydrogen 
atoms) attached to the hexagonal carbon ring. How many isomers are there of xylene? 

8. Find the permutations in corresponding to the permutations (1234) and (12)(34) 
in S4. Confirm that the first consists of a 4-cycle and a 2-cycle and the second consists 
of two 2-cycles and two 1 -cycles. 

9 . Draw the three nonisomorphic graphs on four vertices with 3 edges and the two 
nonisomorphic graphs on four vertices with 4 edges. 

10. 

( 2 ) 

(a) Use the method of Subsection 15.5.3 to find the cycle index of the pair group S_ 
of the symmetric group on five elements. 

(b) Use the cycle index from Item 15. 6.10. a to determine the number of nonisomor- 
phic graphs on five vertices. How many of them have 6 edges? 

11 . Tic-tac-toe is a two-player game played on a 9 X 9 grid. The players mark the 
squares of the grid with the symbols X and O. This exercise uses Polya's enumeration 
theorem to investigate the number of different tic-tac-toe boards. (The analysis of games 
is more complex, since it requires attention to the order the squares are marked and 
stopping when one player has won the game.) 


1 

2 

CO 

4 

5 

6 

7 

00 

9 


Figure 15 . 16 : Numbered squares of a tic-tac-toe board 


(a) Two tic-tac-toe boards are equivalent if one may be obtained from the other by 
rotating the board or flipping it over. (Imagine that it is drawn on a clear piece of 
plastic.) Since the 9x9 grid is a square, the group that acts on it in this manner 
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is the dihedral group D& that we have studied in this chapter. However, as with 
counting nonisomorphic graphs, we have to be careful to choose the way this 
group is represented in terms of cycles. Here we are interested in how permu- 
tations rearrange the nine squares of the tic-tac-toe board as numbered in Fig- 
ure 15.16. For example, the effect of the transformation r\, which rotates the 
board 90° clockwise, can be represented as a permutation of the nine squares as 
(13971)(2684)(5). 

Write each of the eight elements of D$ as permutations of the nine squares of a 
tic-tac-toe board. 

(b) Find the cycle index of Ds in terms of these permutations. 

(c) Make an appropriate substitution for x, in the cycle index to find a generating 
function f(X, O) in which the coefficient on X’O 1 is the number of nonequiva- 
lent tic-tac-toe boards having i squares filled by symbol X and j squares filled by 
symbol O. (Notice that some squares might be blank!) 

(d) How many nonequivalent tic-tac-toe boards are there? 

(e) How many nonequivalent tic-tac-toe boards have three X's and three O's? 

(f) When playing tic-tac-toe, the players alternate turns, each drawing their symbol 
in a single unoccupied square during a turn. Assuming the first player marks her 
squares with X and the second marks his with O, then at each stage of the game 
there are either the same number of X's and O's or one more X than there are 
O's. Use this fact and f(X, O) to determine the number of nonequivalent tic-tac- 
toe boards that can actually be obtained in playing a game, assuming the players 
continue until the board is full, regardless of whether one of them has won the 
game. 

12 . Suppose you are painting the faces of a cube and you have white, gold, and blue 
paint available. Two painted cubes are equivalent if you can rotate one of them so 
that all corresponding faces are painted the same color. Determine the number of 
nonequivalent ways you can paint the faces of the cube as well as the number having 
two faces of each color. 

Hint. It may be helpful to label the faces as U ("up"), D ("down"), F ("front"), B 
("back"), L ("left"), and R ("right") instead of using integers. Working with a three- 
dimensional model of a cube will also aid in identifying the permutations you require. 
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CHAPTER 

The Many Faces of Combinatorics 

16.1 On-line algorithms 

Many applications of combinatorics occur in a dynamic, on-line manner. It is rare that 
one has all the information about the challenges a problem presents before circum- 
stances compel that decisions be made. As examples, a decision to proceed with a 
major construction project must be made several years before ground is broken; in- 
vestment decisions are made on the basis of today's information and may look partic- 
ularly unwise when tomorrow's news is available; and deciding to exit a plane with a 
parachute is rarely reversible. 

In this section, we present two examples intended to illustrate on-line problems in 
a combinatorial setting. Our first example involves graph coloring. As is customary 
in discussions of on-line algorithms, we consider a two-person game with the players 
called Assigner and Builder. The two players agree in advance on a class C of graphs, 
and the game is played in a series of rounds. At round 1 Builder presents a single 
vertex, and Assigner assigns it a color. At each subsequent rounds. Builder presents a 
new vertex, and provides complete information at to which of the preceding vertices 
are adjacent to it. In turn, Assigner must give the new vertex a color distinct from 
colors she has assigned previously to its neighbors. 

Example 16.1. Even if Builder is constrained to build a path on 4 vertices, then Assigner 
can be forced to use three colors. At Round 1, Builder presents a vertex x and Assigner 
colors it. At Round 2, Builder presents a vertex y and declares that x and y are not 
adjacent. 

Now Assigner has a choice. She may either give x and y the same color, or she may 
elect to assign a new color to y. If Assigner gives x and y different colors, then in 
Round 3, Builder presents a vertex z and declares that z is adjacent to both x and y. 
Now Assigner will be forced to use a third color on z. In Round 4, Builder will add a 
vertex w adjacent to y but to neither x nor z, but the damage has already been done. 

On the other hand, if Assigner x and y the same color, then in Round 3, Builder 
presents a vertex z, with z adjacent to x but not to y. Assigner must use a second color 
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on z, distinct from the one she gave to x and y. In Round 4, Builder presents a vertex 
zv adjacent to z and y but not to x. Assigner must use a third color on w. 

Note that a path is a tree and trees are forests. The next result shows that while 
forests are trivial to color off-line, there is a genuine challenge ahead when you have to 
work on-line. To assist us in keeping track of the colors used by Assigner, we will use 
the notation from Chapter 5 and write <p(x ) for the color given by Assigner to vertex x. 

Theorem 16.2. Let nbea positive integer. Then there is a strategy for Builder that will enable 
Builder to construct a forest having at most 2 " _1 vertices while forcing Assigner to use n colors. 

Proof. When n = 1, all Builder does is present a single vertex. When n = 2, two adjacent 
vertices are enough. When n = 3, Builder constructs a path on 4 vertices as detailed in 
Example 16.1. Now assume that for some k > 3, Builder has a strategy S; for forcing 
Assigner to use i colors on a forest of at most 2 ' -1 vertices, for each i = 1,2, ... ,k. 
Here's how Builder proceeds to force k + 1 colors. 

First, for each i = 1,2, ... ,k, Builder follows strategy S; to build a forest F, having 
at most 2'" 1 vertices on which assigner is forced to use i colors. Furthermore, when 
1 < i < j < k, there are no edges between vertices in F, and vertices in F , . 

Next, Builder chooses a vertex ij\ from Fi. Since Assigner uses two colors on F 2 , 
there is a vertex 1/2 from F 2 so that fly 2 ) + 9 ( 1 / 1 ). Since Assigner uses three colors on 
F 3 , there is a vertex 1/3 in F 3 so that { 9 ( 1 / 1 ), 9 ( 1 / 2 ), 9 ( 1 / 3 )} are all distinct. It follows that 
Builder may identify vertices 1 / 1 , 1 / 2 , • ■ • , J/fc with y, e F, so that the colors 9 ( 1 //) satisfy 
cp(yi) + <p(y,) if i + ]■ Builder now presents a new vertex x and declares x adjacent to 
all vertices in {yi, 1 / 2 , • • ■ , J//c} and to no other vertices. Clearly, the resulting graph is a 
forest and Assigner is forced to use a color for x distinct from the k colors she assigned 
previously to the vertices in {yi, y 2 , ■ • ■ , yk}- Also, the total number of vertices is at 
most 1 + [1+2+4 + 8 + ■■■ +2 k ~ 1 ] =2 k . □ 

Discussion 16.3. Bob reads the proof and asks whether it was really necessary to treat 
the cases k = 2 and k = 3 separately. Wasn't it enough just to note that the case k = 1 
holds trivially. Carlos says yes. 

16.1.1 Doing Relatively Well in an On-Line Setting 

Theorem 16.2 should be viewed as a negative result. It is hard to imagine a family of 
graphs easier to color than forests, yet in an on-line setting, graphs in this family are 
difficult to color. On the other hand, in certain settings, one can do reasonably well 
in an on-line setting, perhaps not as well as the true optimal off-line result but good 
enough to be useful. Here we present a particularly elegant example involving partially 
ordered sets. 
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Recall that a poset P of height h can be partitioned into h antichains — by recursively 
removing the set of minimal elements. But how many antichains are required in an 
on-line setting? Now Builder constructs a poset P one point at a time, while Assigner 
constructs a partition of P into antichains. At each round. Builder will present a new 
point x, and list those points presented earlier that are, respectively, less than x, greater 
than x and incomparable with x. Subsequently, Assigner will assign x to an antichain. 
This will be done either by adding x to an antichain already containing one or more of 
the points presented previously, or by assigning x to a new antichain. 

Theorem 16.4. For each h > 1, there is a on-line strategy for Assigner that will enable her to 
partition a poset P into at most (^j 1 ) antichains, provided the height ofP is at most h. 

Proof. It is important to note that Assigner does not need to know the value h in ad- 
vance. For example. Builder may have in mind that ultimately the value of h will be 
300, but this information does not impact Assigner's strategy. 

When the new point x n enters P, Assigner computes the values r and s, where r is 
the largest integer for which there exists a chain C of r points in {xj , % 2 , . . . ,x n j having 
x„ as its least element. Also, s is the largest integer for which there exists a chain D of 
s points in {xi, X 2 , . . . , x„ } having x n as its largest element. Assigner then places x in 
a set A(r, s), claiming that any two points in this set are incomparable. To see that this 
claim is valid, consider the first moment where Builder has presented a new point x, 
Assigner places x in A(r, s ) and there is already a point y in A(r, s ) for which x and y 
are comparable. 

When y was presented, there was at that moment in time a chain C' of r points 
having y as its least element. Also, there was a chain D of s points having y as its 
greatest element. 

Now suppose that y > x in P. Then we can add x to C' to form a chain of r + 1 
points having x as its least element. This would imply that x is not assigned in A{r, s). 
Similarly, if y < x in P, then we may add x to D' to form a chain of s + 1 points having 
x as its greatest element. Again, this would imply that x is not assigned to A(r, s). 

So Assigner has indeed devised a good strategy for partitioning P into antichains, 
but how many antichains has she used? This is just asking how many ordered pairs 
(i, j) of positive integers are there subject to the restriction that i + j — 1 < h. And 
we learned how to solve this kind of question in Chapter 2. The answer of course is 



The strategy for Assigner is so simple and natural, it might be the case that a more 
complex strategy would yield a more efficient partitioning. Not so. 

Theorem 16.5 (Szemeredi). For every h > 1, there is a strategy S/, for builder that will enable 
him to build a poset P of height h so that assigner is forced to (1) use at least (f 1 ) antichains 
in partitioning P, and (2) use at least h different antichains on the set of maximal elements. 
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Proof. Strategy Si is just to present a single point. Now suppose that the theorem holds 
for some integer h > 1 . We show how strategy S/ !+ i proceeds. 

First Builder follows strategy S/, to form a poset Pi. Then he follows it a second time 
for form a poset P2, with all points of Pi incomparable to all points in P2. Now we 
consider two cases. Suppose first that Assigner has used h + 1 or more antichains on 
the set of maximal elements of Pi U Pt. In this case, he follows strategy S/, a third time 
to build a poset P3 with all points of P3 less than all maximal elements of Pi U P2 and 
incomparable with all other points. 

Clearly, the height of the resulting poset is at most h + 1 . Also, Assigner must use 
h + 1 + (^2 ’ ) = f'j 2 ) antichains in partitioning the poset and she has used h + 1 on the 
set of maximal elements. 

So it remains only to consider the case where Assigner has used a set W of h an- 
tichains on the maximal elements of Pi, and she has used exactly the same li antichains 
for the maximal elements of P2. Then Builder presents a new point x and declares it to 
be greater than all points of Pi and incomparable with all points of P2. Assigner must 
put x in some antichain which is not in W. 

Builder then follows strategy S;, a third time, but now all points of P3 are less than x 
and the maximal elements of P2. Again, Assigner has been forced to use h +1 different 
antichains on the maximal elements and antichains altogether. □ 


16.2 Extremal Set Theory 

Let n be a positive integer and let [n] = 1 , 2 In this section, we consider prob- 
lems having the following general form: What is the maximum size of a family of 
subsets of [n] when the family is required to satisfy certain properties. 

Here is an elementary example. 

Example 16.6. The maximum size of a family F of subsets of [n |, with An B + 0 for 
all A,B & F, is 2 " _1 . 

For the lower bound, consider the family F of all subsets of [n ] that contain 1 . Clearly 
this family has 2" _1 elements and any two sets in the family have non-empty intersec- 
tion. 

For the upper bound, let F be a family of subsets with each pair of sets in F having 
non-empty intersection. Then whenever a subset S is a member of F , the complement 
S' of S cannot belong to F ■ Since the entire family of all 2 " subsets of [n] can be con- 
sidered as 2' ,_1 complementary pairs, and at most one set from each pair can belong 
to F, we conclude that \F\ < 2” -1 . 

As a second example, we can revisit Sperner's Theorem from Chapter 6 and restate 
the result as follows. 


312 


16.2 Extremal Set Theory 


Example 16.7. The maximum size of a family F of subsets of [n] subject to the con- 
straint that when A and B are distinct sets in F, then neither is a subset of the other, is 

(|n/2j)‘ 

It is worth noting that in Example 16.7, there is a very small number (one or two) 
of extremal families, i.e., when F is a family of subsets of [n\, \F\ = (p,” 2 j), an d no 
set in F is a proper subset of another, then either f = {S c [n] : |S| = [n/2\ } or 
F = {S c \n | : |S| = \n/ 2]}. And of course, when n is even, these are exactly the same 
family 

On the other hand, for Example 16.6, there are many extremal families, since for 
every complementary pair of sets, either member can be selected. 

We close this brief tasting of extremal set theory with a real classic. 

Theorem 16.8 (Erdos, Ko, Rado). Let n and k be positive integers with n > 2k. Then the 
maximum size of a family F of subsets of[n ] subject to the restrictions that (1) An B + (It for 
all A,B ef, and (2) \A\ = kfor all A eF, is ( n k Z])- 

Proof. For the lower bound, consider the family F of all k element subset of [n] that 
contain 1 . 

For the upper bound, let F be a family of subsets of [)/] satisfying the two con- 
straints. We show that \F\ < (fZ\)- To accomplish this, we consider a circle in the 
Euclidean plane with n points p\, p 2/ ■ ■ ■ , p„ equally spaced points around its circum- 
ference. Then there are n\ different ways (one for each permutation a of [«]) to place 
the integers in [n] at the points in {pi, p 2 , . . . , p„ } in one to one manner. 

For each permutation o of [n |, let F(aj denote the subfamily of F consisting of all 
sets S from F whose elements occur in a consecutive block around the circle. Then let 
t = i,o\no)\. 

Our first claim is that t < kn\. To prove this, let o be a permutation and suppose 
that \F(o)\ = s > 1. Then the union of the sets from F(o) is a set of points that form 
a consecutive block of points on the circle. Note that since n > 2k, this block does not 
encompass the entire circle. Accordingly there is a set S whose elements are the first k 
in a clockwise sense within this block. Since each other set in F represents a clockwise 
shift of one of more positions, it follows immediately that \F\ < k. Since there are n ! 
permutations, the claim follows. 

We now claim that for each set S e F , there are exactly nk\(n - k)\ permutations a 
for which S e F(o). Note that there are n positions around the circle and each can be 
used as the first point in a block of k consecutive positions in which the elements of S 
can be placed. Then there are k\ ways to order the elements of S and (n - k)\ ways to 
order the remaining elements. This proves our claim. 

To complete the proof of the theorem, we note that we have 

\F\nk\(n - k)\ < t < kn\, 
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and this implies that |!F|/e(£_j). 


□ 


16.3 Markov Chains 

We begin this section with a motivational example. Consider the connected graph 
on six vertices shown in ((fig-markovchain)). The first move is to choose a vertex at 
random and move there. Afterwards, we follow the following recursive procedures. If 
after i moves, you are at a vertex x and x has d neighbors, choose one of the neighbors at 
random, with each having probability 1/d and move there. We then attempt to answer 
questions of the following flavor: 

1. For each vertex x, let p x ,m denote the probability that you are at vertex x after m 
moves. Does lim m _>oo p x ,m exist and if so, how fast does the sequence converge 
to this limit? 

2. How many moves must I make in order that the probability that I have walked 
on every edge in the graph is at least 0.999? 

This example illustrates the characteristics of an important class of computational 
and combinatorial problems, which are collectively referred to as Markov Chains: 

1. There is a finite set of states Si, S 2 , . . . , S n , and at time i, you are in one of these 
states. 

2. If you are in state S; at time i, then for each k = 1,2,..., n, there is a fixed prob- 
ability p(j, k) (which does not depend on i) that you will be in state S* at time 
i + 1. 

The n X n matrix P whose j, k entry is the probability p(j, k) of moving from state 
Sj to state St is called the transition matrix of the Markov chain. Note that P is a 
stochastic matrix, i.e., all entries are non-negative and all row sums are 1. Conversely, 
each square stochastic matrix can be considered as the transition matrix of a Markov 
chain. 

For example, here is the transition matrix for the graph in ((fig-markovchain)). 
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1/4 

1/4 

1/4 

1/4 
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1/2 
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A transition matrix P is regular if there is some integer m for which the matrix P m 
has only positive entries. Here is a fundamental result from this subject, one that is 
easy to understand but a bit too complex to prove given our space constraints. 

Theorem 16.9. Let P be a regular n xn transition matrix. Then there is a row vector W = 
(w i, ZV 2 , • ■ - , w n ) of positive real numbers summing to 1 so that as m tends to infinity, each 
row of P m tends to W. Furthermore, WP = W, and for each i = 1,2, ... ,n, the value zvj is 
the limiting probability of being in state Si. 

Given the statement of Theorem 16.9, the computation of the row vector W can be 
carried out by eigenvalue techniques that are part of a standard undergraduate linear 
algebra course. For example, the transition matrix P displayed in Equation (16.3.1) is 
regular since all entries of P 3 are positive. Furthermore, for this matrix, the row vector 
W = (5/13, 3/13, 2/13, 2/13, 1/13, 1/13). However, the question involving how fast the 
convergence of P m is to this limiting vector is more subtle, as is the question as to how 
long it takes for us to be relatively certain we have made every possible transition. 


16.3.1 Absorbing Markov Chains 


= 1 and p, tj = 0 


A state Si in a Markov chain with transition matrix P is absorbing if 
for all j + i, i.e., like the infamous Hotel California, once you are in state Si, "you can 
never leave." 

Example 16.10. We modify the transition matrix from Equation (16.3.1) by making 
states 4 and 5 absorbing. The revised transition matrix is now: 


P = 


( 0 

1/4 

1/4 

1/4 

1/4 

0 \ 

1/2 

0 
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1/2 

0 

0 

1/3 

0 
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1/3 
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1/3 

1/3 
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0 

0 

0 

0 

0 

0 

1 

0 

l o 

0 

0 

0 

0 

1 ) 


(16.3.2) 


Now we might consider the following game. Start at one of the four vertices in 
{1,2, 3,4} and proceed as before, making moves by choosing a neighbor at random. 
Vertex 4 might be considered as an "escape" point, a safe harbor that once reached is 
never left. On the other hand, vertex 5 might be somewhere one meets a hungry tiger 
and be absorbed in a way not to be detailed here. 

We say the Markov chain is absorbing if there is at least one absorbing state and for 
each state Sj that is not absorbing, it is possible to reach an absorbing state — although 
it may take many steps to do so. Now the kinds of questions we would like to answer 
are: 
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1. If we start in non-absorbing state S,, what is the probability of reaching absorbing 
state Sj (and then being absorbed in that state, a question which takes on genuine 
unpleasantness relative to tigers)? 

2. If we are absorbed in state Sj, what is the probability that we started in non- 
absorbing state S ; ? 

3. If we start in non-absorbing state S ( , what is the expected length of time before 
we will be absorbed? 

16.4 The Stable Matching Theorem 

Now we present a light hearted optimization problem with a quite clever solution, 
called the Stable Matching Theorem. There are n eligible males b i, b 2 , ■ ■ . , b , , and n eligi- 
ble females g\, gi, ■ ■ ■ ,g n - (The theorem dates back many years, hence the heteronor- 
mative statement.) We will arrange n marriages, each involving one male and one 
female. In the process, we will try to make everyone happy — or at least we will try to 
keep things stable. 

Each female linearly orders the males in the order of her preference, i.e., for each 
i = 1,2 there is a permutation ct, of [n\ so that if y, prefers bj to ty, then off ) > 
Oi(k). Different females may have quite different preference orders. Also, each male 
linearly orders the females in order of his preference, i.e., for each / = 1 , 2 ,..., n, there 
is a permutation t, of [n] so that if b, prefers y ; to gr, then zfj) > t (k). 

A 1-1 matching of the n males to the n females is stable if there do not exist two 
males b and b' and two females g and g' so that 

1. b is matched to g; 

2. b prefers g' to g; and 

3. g prefers b' to b. 

The idea is that given these preferences, b and g may be mutually inclined to dissolve 
their relationship and initiate dalliances with other partners. 

So the question is whether, regardless of their respective preferences, we can always 
generate a stable matching. The answer is yes and there is a quite clever argument. 
In fact, it is one that yields a quite efficient algorithm. At Stage 1, all males go knock 
on the front door of the female which is tops on their list. It may happen that some 
females have more than one caller while others have none. However, if a female has 
one or more males at her door, she reaches out and grabs the one among the group 
which she prefers most by the collar and tells the others, if there are any, to go away. 
Any male rejected at this step proceeds to the front door of the female who is second 
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on their list. Again, a female with one or more suitors at her door chooses the best 
among then and sends the others away. This process continues until eventually, each 
female is holding onto exactly one male. 

It is interesting to note that each female's prospects improve over time, i.e., once she 
has a suitor, things only get better. Conversely, each male's prospects deteriorate over 
time. Regardless, we assert that the resulting matching is stable. To see this, suppose 
that it is unstable and choose males b and b' , females g and g' so that b is matched to g, 
but b prefers g' to g while g prefers b' to b. The algorithm requires that male b start at 
the top of his list and work his way down. Since he eventually lands on g's door step, 
and he prefers g’ to g, it implies that once upon a time, he was actually at g " s door, 
and she sent him away. This means that at that exact moment, she had a male in hand 
that she prefers to b. Since her holdings only improve with time, it means that when 
the matching is finalized, female g has a mate b that she prefers to b'. 


16.5 Zero-One Matrices 

Matrices with all entries 0 and 1 arise in many combinatorial settings, and here we 
present a classic result, called the Gale-Ryser theorem. It deals with zero-one matrices 
with specified row and column sum strings. When M is an m X n zero-one matrix, the 
string R = (r\, ri , . . . , where r; = X i</<h m i,j> is called the row sum string of M. 
The column sum string C = (ci, C2, ■ • . , c„) is defined analogously. Conversely, let m 
and n be positive integers, and let R = (r\, jq, ■ ■ ■ , r m ) and C = (ci, C2, . . . , c n ) be strings 
of non-negative integers. The question is whether there exists an mxn zero-one matrix 
M with row sum string R and column sum string C. 

To attack this problem, we pause briefly to develop some additional background 
material. Note that we may assume without loss of generality that there is a positive 
integer t so that ^Li r ‘ = ZJ= i c j = C else there is certainly no zero-one matrix with 
row sum string R and column sum string C. Furthermore, we may assume that both 
R and C are non-increasing strings, i.e., ri > fq > ■ ■ ■ > r m and C\ > C 2 > ■ ■ ■ > c n . 

To see this note that whenever we exchange two rows in a zero-one matrix, the col- 
umn sum string is unchanged. Accordingly after a suitable permutation of the rows, 
we may assume that R is non-increasing. Then the process is repeated for the columns. 

Finally, it is easy to see that we may assume that all entries in R and C are positive 
integers, since zeroes in these strings correspond to rows of zeroes or columns of zeroes 
in the matrix. Accordingly, the row sum string R and the column sum string C can be 
viewed as partitions of the integer f, a topic we first introduced in Chapter 8. 

For the balance of this section, we let t be a positive integer and we let P(t) denote 
the family of all partitions of the integer t. There is a natural partial order on !P(f) 
defined by setting V = (iq, iq, . . . , v m ) > W = (wq, w 2 , . . . , zv n ) if and only if m < n 
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and Yj\<i<j v j ^ Zi<i<; w j for each j = 1,2, ... ,m, i.e., the sequence of partial sums for 

V is always at least as large, term by term, as the sequence of partial sums of W. For 
example, we show in ((fig-partitionlattice)) the partial order P(7). 

FIGURE HERE 

In the proof of the Gale-Ryser theorem, it will be essential to fully understand when 
one partition covers another. We state the following proposition for emphasis; the 
proof consists of just considering the details of the definition of the partial order on 
partitions. 

Proposition 16.11. Let V = (v\, z’ 2 , ■ . . , v m ) and W = {w\, 102 , ■ ■ . , w n ) be partitions of an 
integer t. If V covers W in the poset P(t), then n < m + 1 and there exist integers i and j with 
1 < i < j < n so that the following statements hold. 

1. v a - w a , when 1 < a < i. 

2. vp = wp, when j < (i < m. 

3. Vi = 1 + Wj. 

4. Either (a) j < m and Wj = 1 + Vj, or (b) j = n = m + 1 and Wj = 1. 

5. If j > i + 1, then w y = v y = v, - 1 when i < y < j. 

To illustrate this concept, note that (5,4,3) covers (5,3,3, 1) in P(12). Also, we see 
(6, 6, 4, 3, 3, 3, 1, 1, 1, 1, ) covers (6, 6, 3, 3, 3, 3, 2, 1, 1, 1) in P{ 29). 

With a partition V = (v\, z> 2 , . . . ,v m ) from P(t), we associate a dual partition W = 
{w\, W 2 , . . . ,w n ) defined as follows: (1) n = v\ and for each j = 1 Wj is the 
number of entries in V that are at least n + 1 — j. For example, the dual partition of 

V = (8, 6, 6, 6, 5, 5, 3, 1, 1, 1) is (8, 7, 7, 6, 6, 4, 1, 1). Of course, they are both partitions 
of 42, which is the secret of the universe! In what follows, we denote the dual of the 
partition V by V d . Note that if W = V A , then V = W d , i.e., the dual of the dual is the 
original. 

16.5.1 The Obvious Necessary Condition 

Now let M be a m X n zero-one matrix with row sum string R = ( r 1 , j' 2 , . . . , r m and 
column sum string C = (ci, C 2 , . . . , c n ). As noted before, we will assume that all entries 
in R and C are positive. Next, we modify M to form a new matrix M' as follows: For 
each i = 1,2 , . . . ,t, we push the r,- ones in row i as far to the left as possible, i.e., m'. . = 1 
if and only if 1 < j < r,. Note that M and M' both have R for their row sum strings. 
However, if C' denotes the column sum string for M', then C 1 is a non-decreasing string, 
and the substring C" of C' consisting of the positive entries is R rf , the dual partition of 
R. Furthermore, for each j = 1,2, ... , r j, we have the inequality 2i<;</ c" - Si <i<j c it 
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since the operation of shift ones to the left can only increase the partial sums. It follows 
that R d > C in the poset P{t). 

So here is the Gale-Ryser theorem. 

Theorem 16.12 (Gale-Ryser). Let R and C be partitions of a positive integer t. Then there 
exists a zero-one matrix with row sum string R and column sum string C if and only ifR d > C 
in the poset 'Pit). 

Proof. The necessity of the condition has been established. We prove sufficiency. The 
proof is constructive. In the poset P(t, let Wo > Wi > • • • > W s be a chain so that 
(1) Wo = R d , (2) W s = C and (3) if 0 < p < s, then W p covers W p+ i. We start with 
a zero one matrix Mo having row sum string R and column sum string Wo, as sug- 
gested in ((fig-dualpartition)) for the partition (8,4, 3, 1, 1, 1). If s =0, we are done, 
so we assume that for some p with 0 < p < s, we have a zero-one matrix M p with 
row sum string R and column sum string W p . Then let i and j be the integers from 
Proposition 16.11, which detail how W p covers W p+ i- Choose a row q so that the q , i 
entry of M p is 1 while the q, j entry of M is 0. Exchange these two entries to form the 
matrix M p +i . Note that the exchange may in fact require adding a new column to the 
matrix. □ 


16.6 Arithmetic Combinatorics 

In recent years, a great deal of attention has been focused on topics in arithmetic com- 
binatorics, with a number of deep and exciting discoveries in the offing. In some sense, 
this area is closely aligned with Ramsey theory and number theory, but recent work 
shows connections with real and complex analysis, as well. Furthermore, the roots 
of arithmetic combinatorics go back many years. In this section, we present a brief 
overview of this rich and rapidly changing area. 

Recall that an increasing sequence a\ < «2 < ^3 < • ■ • < at) of integers is called an 
arithmetic progression when there exists a positive integer d for which a ; + \ - a t = d, 
for all i = 1,2, . . . ,t — 1. The integer t is called the length of the arithmetic progression. 

Theorem 16.13. For pair r, t of positive integers, there exists an integer no, so that ifn > no 
and (p : {1,2, ... ,n} — > {1,2, ... ,r} is any function, then there exists a t-term arithmetic 
progression 1 < a\ < a 2 < . ■ . < a t < n and an element a e {1,2, ... ,r} so that (p(tii) = a, 
for each i = 1,2, ... ,t. 


Material will be added here. 
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16.7 The Lovasz Local Lemma 

Even though humans seem to have great difficulty in providing explicit constructions 
for exponentially large graphs which do not have complete subgraphs or independent 
sets of size n, such graphs exist with great abundance. Just take one at random and 
you are almost certain to get one. And as a general rule, probabilistic techniques often 
provide a method for finding something that readily exists, but is hard to find. 

Similarly, in the probabilistic proof that there exist graphs with large girth and large 
chromatic number (Theorem 11.7), we actually showed that almost all graphs have 
modest sized independence number and relatively few small cycles, provided that the 
edge probability is chosen appropriately. The small cycles can be destroyed without 
significantly changing the size of the graph. 

By way of contrast, probabilistic techniques can, in certain circumstances, be used 
to find something which is exceedingly rare. We next present an elegant but elemen- 
tary result, known as the Lovasz Local Lemma, which has proved to be very, very 
powerful. The treatment is simplified by the following natural notation. When £ is 
an event in a probability space, we let E denote the complement of £ . Also, when 
T = {Ei, £ 2 , ...,£jt} we let 


k 

1 1 E = FI £' = EiE^ 3 • ■ • Eft 

Eer i=l 

denote the event £1 fl £2 IT • • • fl £/ c , i.e., concatenation is short hand for intersection. 
These notations can be mixed, so E 1 E 2 E 3 represents £1 n E 2 fl E 3 . Now let F be a finite 
family of events, let E e F and let N be a subfamily of F - {£}. In the statement of 
the lemma below, we will say that £ is independent of any event not in N when 

P(E| Y[¥) = P(E) 


provided Q C N = $. 

We first state and prove the lemma in asymmetric form. Later, we will give a simpler 
version which is called the symmetric version. 

Lemma 16.14 (Lovasz Local Lemma (Asymmetric)). Let F be a finite family of events in a 
probability space and for each event E e F , let N(E) denote a subfamily of events from F - {£ } 
so that E is independent of any event not in N(E). Suppose that for each event E e F, there is 
a real number x(E) with 0 < x(E) < 1 such that 

P(E) < x(E) ["[ (1 -*(£)). 

FeJV(E) 
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Then for every non-empty subfamily gcf, 

nn^n^))- 

Ee£ Ee£ 

In particular, the probability that all events in 'T fail is positive. 

Proof. We proceed by induction on @. If \(f \ = 1 and Q = {£}, we are simply asserting 
that P(£) > 1 — x(E), which is true since P(E ) < x(E). Now suppose that \Q\ = k > 2 
and that the lemma holds whenever 1 < \Q\ < k. Let Q - {E\ , Eo, . . . , E/t}- Then 

k k k k 

p(f[ id = p(ei i y] Ei)P(Ei i n n*>- 

i> 1 i=2 i=3 i=4 

Now each term in the product on the right has the following form: 

pee i n 

FzTe 

where |^e| < k. 

So, we done if we can show that 

p(£i n^i - x ( £ ) 

FzTe 

This is equivalent to showing that 

P(E| n F) < *(E) 

F£Te 

Suppose first that 7>: n Af(£) = 0. Then 

P(E I n F) = P(E) < x(E). 

F£Te 


So we may assume that n AZ'(E) + 0. Let = {Fi / F 2 ,F ) -,F r+ i,F r+ 2 , . . . ,Ff}, with 
F, e Ne if and only if r + 1 < i < t . Then 

pe I FT p) = p ( £ Ufennfm E 1 Urcn-rm E ) 

FuTe E’dlfeyinAtfE) E) 

Consider first the numerator in this last expression. Note that 

P(£ n pi n f) < p(E| Y\ F ) - x ( £ ) n (1 - x(F)) 

F£Te rW(E) Fer E - ME) FeTirW(E) FzTe rW(E) 
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Next, consider the denominator. By the inductive hypothesis, we have 

p,n ef E n N(E)F > 0 

F FzTe rW(E) 

Combining these last two inequalities, we have 

P(E| n F) < x(E) f[ (1 - x(F)) < x(E), 

FcTe N(E)-Te 

and the proof is complete. □ 

Now here is the symmetric version. 

Lemma 16.15 (Lovasz Local Lemma (Symmetric)). Let p and d be numbers with 0 < p < 1 
and d > 1. Also, let F be a finite family of events in a probability space and for each event 
E e F , let N(E) denote the subfamily of events from F - {£} so that E is independent of 
any event not in N(E). Suppose that P(E) < p, |Af(£)| < d for every event E e F and that 
ep(d + 1) < 1, where e = 2.71828 ... is the base for natural logarithms. Then 

p( ii F) - ri (i “ x(E)) ' 

Eer E£0 

i.e., the probability that all events in F is positive. 

Proof. Set x(E) = l/(d + 1) for every event E e F ■ Then 

□ 

A number of applications of the symmetric form of the Lovasz Local Lemma are 
stated in terms of the condition that 4 pd < 1 . The proof of this alternate form is just a 
trivial modification of the argument we have presented here. 


16.8 Applying the Local Lemma 

The list of applications of the Local Lemma has been growing steadily, as has the in- 
terest in how the lemma can be applied algorithmically, i.e., in a constructive setting. 
But here we present one of the early applications to Ramsey theory — estimating the 
Ramsey number ( R , 3, n). Recall that we have the basic inequality R(3, n ) < (" 3 X ) from 
Theorem 11.2, and it is natural to turn to the probabilistic method to look for good 
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lower bounds. But a few minutes thought shows that there are challenges to this ap- 
proach. 

First, let's try a direct computation. Suppose we try a random graph on t vertices 
with edge probability p. So we would want no triangles, and that would say we need 
f 3 p 3 = 1, i.e., p = 1 /t. Then we would want no independent sets of size n, which would 
require n 1 e~ p " 2 = 1, i.e., t in a = pn 2 , so we can't even make t larger than n. That's not 
helpful. 

We can do a bit better by allowing some triangles and then removing one point from 
each, as was done in the proof for Theorem 11.7. Along these lines, we would set 
f 3 p 3 = t, i.e., p = f -2 / 3 . And the calculation now yields the lower bound R(3, n) > 
n 6 / 5 / ln _3/5 n, so even the exponent of n is different from the upper bound. 

So which one is right, or is the answer somewhere in between? In a classic 1961 
paper, Erdos used a very clever application of the probabilistic method to show the 
existence of a graph from which a good lower bound could be extracted. His technique 
yielded the lower bound R( 3, n ) > n 2 / In 2 n, so the two on the exponent of n is correct. 

Here we will use the Lovasz Local Lemma to obtain this same lower bound in a much 
more direct manner. We consider a random graph on t vertices with edge probability 
p. For each 3-element subset S, we have the event E$ which is true when S forms a 
triangle. For each n -element set T, we have the event Ej which is true when T is an 
independent set. In the discussion to follow, we abuse notation slightly and refer to 
events Es and Ej as just S and T, respectively. Note that the probability of S is p 3 for 
each 3-element set S, while the probability of T is q = (1 - p) C( ''' 2 - 1 ~ e~ pn ^ 2 for each 
n -element set T. 

When we apply the Local Lemma, we will set x = x(S) to be e 2 p 3 , for each 3-element 
set S. And we will set y = Y(T) = q 1 /2 ~ e -p« 2 /4_ It will be clear in a moment where 
we got those values. 

Furthermore, the neighborhood of an event consists of all sets in the family which 
have two or more elements in common. So the neighborhood of a 3-element set S 
consists of 3(f - 3) other 3-element sets and C(t - 3, n — 3) + 3C(f - 3, n -2) sets of size n . 
Similarly, the neighborhood of an n-element set T consists of C(n, 3) + (f — n)C{n, 2) 
sets of size 3 and Yu'jZi C ( n , i)C(t-n,n - i ) other sets of size n. So the basic inequalities 
we need to satisfy are: 

p 3 <x(l - x) 3 ( f - 3 >(l - y^C(t-3,n-3)+3C(t-n,n-2) 
q <1/(1 - x )C('i,3)+((-tt)C(H,2)^ _ y^C(t—3,n—3)+3C(t-n,n-2) 

Next, we assume that n 3 ^ 2 < t < n 2 and then make the usual approximations, ignoring 
smaller order terms and multiplicative constants, to see that these inequalities can be 
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considered in the following simplified form: 

p 3 <x(l - x)f 1 - yf 
q <yC 1 - x) tn \l - y) tn 

A moments reflection makes it clear that we want to keep the terms involving (1 - y) 
relatively large, i.e., at least 1/e. This will certainly be true if we keep t" < 1/y. This is 
equivalent to n In t < pn 2 , or In t < pn. 

Similarly, we want to keep the term (1 - xf relatively large, so we keep f < 1 jx, 
i.e., t < 1/p 3 . On the other hand, we want only to keep the term (1 - x) lir ~ e~ xt ' r at 
least as large as y. This is equivalent to keeping p < xt, and since x ~ p 3 , this can be 
rewritten as p~ l < t 1 ^ 2 . 

Now we have our marching orders. We just set Inf = pn and p _1 = f 1 ^ 2 . After 
substituting, we get t = n 2 /\rC t and since Inf = Inn (at least within the kind of 
approximations we are using), we get the desired result f = n 2 / In 2 n. 
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Epilogue 

Here is a progress report on our cast of characters, some five years after graduation 1 . 

Alice and Bob got married, moved to Austin, Texas, and started a high tech firm using 
venture capital provided by a successful Georgia Tech grad. Alice is CEO and the 
pattern of making quick decisions, most of which are right, continues to this day. Bob 
is CFO and the financial health of the firm is guaranteed. The first year though was 
pretty tough, but after that, their reputation got established and contracts began to 
walk through the door. There's even talk about an IPO in the near future. Alice and 
Bob don't have much time to decide whether they are happy with the way their lives 
are going — but we're pretty sure they are. 

Carlos switched from Physics to math for graduate school and won an NSF gradu- 
ate fellowship which he took at MIT. After receiving his Ph.D., he took a postdoctoral 
position at the American Institute for the Mathematical Sciences (AIMS). He also won 
an NSF Career grant. Carlos is a rapidly emerging star in the academic world. He 
has universities lining up to offer him tenure-track positions and he had already been 
invited to lecture in England, France, Germany, Hungary and Poland. He'll make a 
good living, not a huge salary, but the quality of life will rank with the best. He is very 
happy. 

Dave surprised a lot of people. Somewhere along the way, he got just a bit more 
organized without losing that off-the-wall uniqueness that made him special. He took 
a job on Wall Street with a firm that just wanted really very smart people. He's making 
more money than any other member of the group, by far. But it comes at some cost. 
Long hours and lots of stress. On the occasional free Sunday (there aren't many), he 
wonders how much longer he can keep this up. 

Xing took a job with Macrofirm in Bluemon. His group is developing new operating 
systems and attendant software that run on computing devices of all sizes, from smart 
phones through super computers. Lots of interesting challenges, for example, just in 
deciding how input should be done when there's no keyboard and the device screen 

1 Georgia Tech students do not speak of graduating. Instead, using the same phrase applied to incarceration, 
they talk about getting out. 
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is very small. Xing is enjoying life and feels his Georgia Tech experiences were great 
preparation. 

Yolanda used her chemistry background to go to medical school at Emory University, 
where she received both an M.D. and a Ph.D. Afterwards, she accepted a position at 
the Center for Disease Control (CDC), which is also located here in Atlanta and has a 
bunch of scientists with the same kind of background training. Zori quickly became 
the go to person for analyzing strange viruses which no one else was able to identify. 
She is part of a very important safety net which is essental to the nation's security and 
well-being. She is very happy with her life. 

Zori didn't go down the pathway through life she once envisioned. Her first job 
was with a family owned company making candy bars. In that position, she helped 
them to make wise decisions on massive sugar purchases made on a world-wide basis. 
She got bored with this job, and left to accept a position with a support group for an 
airline company. Her group did optimization work, figuring out how best to position 
aircraft and crews to handle scheduling irregularities. Two years later, she moved to a 
position with a major chip maker where she helped optimize the movement of cutting 
heads in the manufacturing process, where incremental improvements could mean 
for hundreds of millions of dollars in savings. Zori has made lots of money, but she 
remains vaguely dissatisfied with life and is still looking for the right environment. 


326 



APPENDIX 


Background Material for 

Combinatorics 


This appendix treats background material essential to the study of combinatorial math- 
ematics. Many students will find that most — and perhaps all — of this material has 
been covered somewhere in their prior course work, and we expect that very few in- 
structors will include this appendix in the syllabus. Nevertheless, students may find 
it convenient to consult this appendix from time to time, and we suspect that many 
instructors will encourage students to read this material to refresh their memories of 
key concepts. 

B.l Introduction 

Set theory is concerned with elements, certain collections of elements called sets and a 
concept of membership. For each element x and each set X, exactly one of the following 
two statements holds: 

1. x is a member of X. 

2. x is not a member of X. 

It is important to note that membership cannot be ambiguous. 

When x is an element and X is a set, we write x E X when x is a member of X. 
Also, the statement x belongs to X means exactly the same thing as x is a member of 
X. Similarly, when x is not a member of X, we write x £ X and say x does not belong 
toX. 

Certain sets will be defined explicitly by listing the elements. For example, let X = 
{a,b,d,g,m}. Then b E X and h £ X. The order of elements in such a listing is 
irrelevant, so we could also write X = {g / d,b,m, a}. In other situations, sets will be 
defined by giving a rule for membership. As examples, let N denote the set of positive 
integers. Then let X = {n E N : 5 < n < 9}. Note that 6, 8 e X while 4, 10, 238 £ X. 
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Given an element x and a set X, it may at times be tedious and perhaps very difficult 
to determine which of the statements x e X and x £ X holds. But if we are discussing 
sets, it must be the case that exactly one is true. 

Example B.l. Let X be the set consisting of the following 12 positive integers: 

13232112332 

13332112332 

13231112132 

13331112132 

13232112112 

13231112212 

13331112212 

13232112331 

13231112131 

13331112131 

13331112132 

13332112111 

13231112131 

Note that one number is listed twice. Which one is it? Also, does 13232112132 belong 
to X? Note that the apparent difficulty of answering these questions stems from (1) 
the size of the set X and (2) the size of the integers that belong to X. Can you think of 
circumstances in which it is difficult to answer whether x is a member of X even when 
it is known that X contains exactly one element? 

Example B.2. LetP denote the set of primes. Then 35 £ P since 35 = 5x7. Also, 19 e P. 
Now consider the number 

n = 77788467064627123923601532364763319082817131766346039653933 

Does n belong to P? Alice says yes while Bob says no. How could Alice justify her 
affirmative answer? How could Bob justify his negative stance? In this specific case, I 
know that Alice is right. Can you explain why? 

B.2 Intersections and Unions 

When X and Y are sets, the intersection of X and Y, denoted X fi Y , is defined by 

Xn Y = {x : x e X,x e Y} 
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Note that this notation uses the convention followed by many programming languages. 
Namely, the "comma" in the definition means that both requirements for membership 
be satisfied. For example, if X = {b, c, e, g, m} and Y = {a,c,d,h,m,n,p}, then X n 
Y = {c, m}. 

B.2.1 The Meaning of 2-Letter Words 

In the not too distant past, there was considerable discussion in the popular press on 
the meaning of the 2-letter word is. For mathematicians and computer scientists, it 
would have been far more significant to have a discussion of the 2-letter word or. The 
problem is that the English language uses or in two fundamentally different ways. Con- 
sider the following sentences: 

1 . A nearby restaurant has a dinner special featuring two choices for dessert: flan 
de casa or tirami-su. 

2. A state university accepts all students who have graduated from in-state high 
schools and have SAT scores above 1000 or have grade point averages above 3.0. 

3. A local newspaper offers customers the option of paying their for their newspa- 
per bills on a monthly or semi-annual basis. 

In the first and third statement, it is clear that there are two options but that only 
one of them is allowed. Flowever, in the second statement, the interpretation is that 
admission will be granted to students who satisfy at least one of the two requirements. 
These interpretations are called respectively the exclusive and inclusive versions of 
or. In this class, we will assume that whenever the word "or" is used, the inclusive 
interpretation is intended — unless otherwise stated. 

For example, when X and Y are sets, the union of X and Y, denoted X U Y, is defined 
by 

XuY = {j : j e j or x e Y}. 

For example, if X = {b , c, e, g, m} and Y = {a, c, d,h, m,n,p}, then 

X U Y = {a,b ,c,d,e, g ,h,m,n,p}. 

Note that fl and U are commutative and associative binary operations, as is the case 
with addition and multiplication for the set N of positive integers, i.e., if X, Y and Z 
are sets, then 

XnY = YnX and XuY = YuX. 

Also, 

Xn(YDZ)^{XDY)nZ and X U (Y U Z) = (X U Y) u z. 
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Also, note that each of fl and U distributes over the other, i.e., 

x n (Y u z) = (X n Y) u (X n z) and x u (Y n z) = (X u Y) n (X u z) 

On the other hand, in N, multiplication distributes over addition but not vice-versa. 


B.2.2 The Empty Set: Much To Do About Nothing 

The empty set, denoted 0 is the set for which x £ 0 for every element x. Note that 
X IT 0 = 0 and X U 0 = X, for every set X. 

The empty set is unique in the sense that if x i X for every element x, then X = 0. 


B.2.3 The First So Many Positive Integers 

In this text, we will use the symbols N, Z, Q and R to denote respectively the set of 
positive integers, the set of all integers (positive, negative and zero), the set of rational 
numbers (fractions) and the set of real numbers (rationals and irrationals). Qn occa- 
sion, we will discuss the set No of non-negative integers. When n is a positive integer, 
we will use the abbreviation [n] for the set {1,2,...,/?} of the first n positive integers. 
For example, [5] = {1,2, 3, 4, 5}. For reasons that may not be clear at the moment but 
hopefully will be transparent at the right moment, we use the notation n to denote the 
//-element set {0, 1,2 - 1}. Of course, n is just the set of the first n non-negative 
integers. For example, 5 = {0, 1,2, 3, 4}. 


B.2.4 Subsets, Proper Subsets and Equal Sets 

When X and Y are sets, we say X is a subset of Y and write X c Y when x £ Y for 
every x e X. When X is a subset of Y and there exists at least one element j £ Y with 
y £ X, we say X is a proper subset of Y and write X c Y . For example, the P of primes 
is a proper subset of the set N of positive integers. 

Surprisingly often, we will encounter a situation where sets X and Y have different 
rules for membership yet both are in fact the same set. For example, let X = {0, 2} and 
Y = {zeZ:z+z = zx z}. Then X = Y. For this reason, it is useful to have a test 
when sets are equal. If X and Y are sets, then 

X = Y if and only if X c Y and Y c X. 
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B.3 Cartesian Products 

When X and Y are sets, the cartesian product of X and Y , denoted X X Y , is defined 
by 

X X Y = {( x,y ) : x e X and y e Y} 

For example, if X = {a, b} and Y = [3], then 

X x Y = {(«, 1), (b, 1), (a, 2), (b, 2), (a, 3), (b, 3)}. 

Elements of X X Y are called ordered pairs. When p = (x, y) is an ordered pair, the 
element x is referred to as the first coordinate of p while y is the second coordinate of 
p. Note that if either X or Y is the empty set, then X X Y = 0. 

Example B.3. Let X = {0, (1,0), {0}} and Y = {(0,0)}. Is ((1,0), 0) a member of X X Y? 

Cartesian products can be defined for more than two factors. When n > 2 is a posi- 
tive integer and Xi, X 2 , . . . , X„ are non-empty sets, their cartesian product is defined 
by 

Xi X X 2 X • • • X X„ = {(xi,X 2 , ■ ■ . ,x n ) : Xi e Xj for i = 1,2, . . . , n} 


B.4 Binary Relations and Functions 

A subset RcXxY is called a binary relation on X X Y, and a binary relation R on 
X X Y is called a function from X to Y when for every x e X, there is exactly one element 
y e Y for which (x, y) e R. 

Many authors prefer to write the condition for being a function in two parts: 

1. For every x e X, there is some element y e Y for which (x, y) e R. 

2. For every x e X, there is at most one element y e Y for which (x, y) e R. 

The second condition is often stated in the following alternative form: If x € X, 
yi, y 2 e Y and (x, yi), (x, y 2 ) e R, then yi = y 2 . 

Example B.4. For example, let X = [4] and Y = [5]. Then let 

Ri = {(2,1), (4, 2), (1,1), (3,1)} 

R 2 = {(4,2), (1,5), (3, 2)} 

R 3 = {(3,2), (1,4), (2, 2), (1,1), (4, 5)} 

Of these relations, only R 1 is a function from X to Y. 
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In many settings (like calculus), it is customary to use letters like /, g and h to denote 
functions. So let / be a function from a set X to a set Y. In view of the defining proper- 
ties of functions, for each x e X, there is a unique element y e Y with (x , y) e f. And 
in this case, the convention is to write y = fix'). For example, i f f = R i is the function 
in Example B.4, then 2 = /( 4) and /( 3) = 1. 

The shorthand notation / : X — » Y is used to indicate that / is a function from the 
set X to the set Y. 

In calculus, we study functions defined by algebraic rules. For example, consider 
the function / whose rule is f{x) = 5x 3 - 8x + 7. This short hand notation means that 
X = Y = R and that 

/ = {(x, 5x 3 - 8i + 7) : i e R} 

In combinatorics, we sometimes study functions defined algebraically, just like in cal- 
culus, but we will frequently describe functions by other kinds of rules. For example, 
let / : N — » N be defined by f(n) = \n/2\ if n is even and f(n) = 3|n| + 1 when n is 
odd. 

A function / : X — » Y is called an injection from X to Y when for every y e Y, there 
is at most one element x e X with y = fix). 

When the meaning of X and Y is clear, we just say / is an injection. An injection is 
also called a 1-1 function (read this as "one to one") and this is sometimes denoted as 

/:X^>Y. 

A function / : X — » Y is called a surjection from X to Y when for every y e Y, there 
is at least one x e X with y = fix). 

Again, when the meaning of X and Y is clear, we just say / is a surjection. A surjec- 
tion is also called an onto function and this is sometimes denoted as / : X > Y. 

onto 

A function / from X to Y which is both an injection and a surjection is called a 
bijection. Alternatively, a bijection is referred to as a 1-1, onto function, and this is 

sometimes denoted as / : X * Y . A bijection is also called a 1-1-correspondence. 

onto 

Example B.5. Let X = Y = R. Then let /, g and h be the functions defined by 

1. fix) = 3x-7. 

2. gix) = 3(x - 2)(x + 5)(x - 7). 

3. h(x) = 6x 2 - 5x + 13. 

Then / is a bijection; g is a surjection but not an injection (Why?); and h is neither an 
injection nor a surjection (Why?). 

Proposition B.6. Let X and Y be sets. Then there is a bijection from XtoY if and only if there 
is a bijection from Y to X. 
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B.5 Finite Sets 

A set X is said to be finite when either (1) X = 0; or (2) there exists positive integer n 
and a bijection / : [n] — — > X. When X is not finite, it is called infinite. For example, 

onto 

{a, 0, (3, 2), N} is a finite set as is N X 0. On the other hand, N X {0} is infinite. Of 
course, [ n ] and n are finite sets for every n £ N. 

Proposition B.7. If X be a non-empty finite set, then there is a unique positive integer n for 
ivliich there is a bijection f : [ n ] — b X. 

onto 

In some cases, it may take some effort to determine whether a set is finite or infinite. 
Here is a truly classic result. 

Proposition B.8. The set P of primes is infinite. 

Proof. Suppose that the set P of primes is finite. It is non-empty since 2 £ P. Let n be 
the unique positive integer for which there exists a bijection / : [n] — » P. Then let 

P = 1 + /(l) x /(2) x /(3) x • • • x /(«) 

Then p is not divisible by any of the primes in P but is larger than any element of P. 
Thus, either p is prime or there is a prime that does not belong to P. The contradiction 
completes the proof. □ 

Here's a famous example of a set where no one knows if the set is finite or not. 

Conjecture B.9. It is conjectured that the following set is infinite: 

T = {n £ N : n and n + 2 are both primes }. 

This conjecture is known as the Twin Primes Conjecture. Guaranteed A + + for any 
student who can settle it! 

Proposition B.10. Let X and Y be finite sets. If there exists an injection f : X — 4 Y and an 
injection a : Y — 4 X, then there exists a bijection h : X — ^ Y. 

onto 

When X is a finite non-empty set, the cardinality of X, denoted |X| is the unique 
positive integer n for which there is a bijection / : [n] - — -» X. Intuitively, |X| is the 
number of elements in X. For example, 

l{(6,2), (8, (4,0)), {3, {5}}}| = 3. 

By convention, the cardinality of the empty set is taken to be zero, and we write |0| =0. 
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Proposition B.ll. IfX and Y are finite non-empty sets, then \X X Y| = |X| x |Y|. 

We note that the statement in Proposition B.ll is an example of "operator overload- 
ing", a technique featured in several programming languages. Specifically, the times 
sign X is used twice but has different meanings. As part of X X Y, it denotes the carte- 
sian product, while as part of |X| X \Y\, it means ordinary multiplication of positive 
integers. Programming languages can keep track of the data types of variables and 
apply the correct interpretation of an operator like X depending on the variables to 
which it is applied. 

We also have the following general form of Proposition B.ll: 

|Xi X X 2 X • • • X X„| = |X a | X |X 2 | X • • • X \X n \ 


Theorem B.12. 

1. There is a bijection between any tivo of the following infinite sets N, Z and Q. 

2. There is an injection from Q to R 

3. There is no surjection from Q to R. 

B.6 Notation from Set Theory and Logic 

In set theory, it is common to deal with statements involving one or more elements 
from the universe as variables. Here are some examples: 

1. For n e N, n 2 - 6n + 8 = 0. 

2. For A c [100],{2,8,25,58,99} c A. 

3. For n e Z, \n | is even. 

4. For x e R, 1 + 1 = 2. 

5. For m,n e N, m{m + 1) + 2n is even. 

6. For n e N, In + 1 is even. 

7. For n e N and x eR,o + x is irrational. 

These statements may be true for some values of the variables and false for others. 
The fourth and fifth statements are true for all values of the variables, while the sixth 
is false for all values. 

Implications are frequently abbreviated using with a double arrow =>; the quan- 
tifier V means "for all" (or "for every"); and the quantifier 3 means "there exists" (or 
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"there is"). Some writers use A and V for logical "and" and "or", respectively. For 
example, 

VA, B c [4] ((1,2 e A) A \B\ > 3)) => ((A c B) V (3n e A U B, n 2 = 16)) 

The double arrow <=> is used to denote logical equivalence of statements (also "if 
and only if"). For example 

VAC [7] A fi {1,3,6} V 0 <=> A $£ {2, 4,5,7} 

We will use these notational shortcuts except for the use of A and V, as we will use these 
two symbols in another context: binary operators in lattices. 


B.7 Formal Development of Number Systems 

Up to this point, we have been discussing number systems in an entirely informal man- 
ner, assuming everyone knew all that needed to be known. Now let's pause and put 
things on a more firm foundation. So for the time being, do a memory dump and for- 
get everything you have ever learned about numbers and arithmetic. The set of natural 
numbers has just been delivered on our door step in a big box with a warning label say- 
ing Assembly Required. We open the box and find a single piece of paper on which the 
following "instructions" are printed. These defining properties of the natural numbers 
are known as the Peano Postulates. 

i There is a non-empty set of elements called natural numbers. There is natural 
number called zero which is denoted 0. The set of all natural numbers is denoted 
N 0 

ii There is a one-to-one function s : No — > No called the successor function. For 
each n e No, s(n) is called the successor of n. 

iii There is no natural number n for which 0 = s(n). 

iv Let M c No. Then M = No if and only if 

a 0 e M; and 

b VteN 0 (ke M) =t> (s(k) e M). 

Property iv in the list of Peano Postulates is called the Principle of Mathematical 
Induction, or just the Principle of Induction. As a first application of the Principle of 
Induction, we prove the following basic property of the natural numbers. 
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Proposition B.13. Let n be a natural number with n + 0. Then there is a natural number m 
so that n = s(m). 

Proof. Let S = {n e No : 3m e No ,n = s(m)}. Then set M = {0} U $. We show that 
M = No. First, note that 0 £ M. Next, we will show that for all k £ No, if k £ M, 
then s(k) £ M. However, this is trivial since for all k £ No, we have s(k) £ Sc M. We 
conclude that M = No. □ 

B.7.1 Addition as a Binary Operation 

A binary operation * on set X is just a function * : X X X — > X. So the image of 
the ordered pair (x, y) would normally be denoted *((x, y)). However, this is usually 
abbreviated as *(x, y) or even more compactly as x * y. With this convention, we now 
define a binary operation + on the set No of natural numbers. This operation is defined 
as follows for every natural number n £ No: 

i n + 0 = n . 

ii For all k £ No, n + s(k) = s(n + k). 

We pause to make it clear why the preceding two statements define +. Let n be an 
arbitrary natural number. Then let M denote the set of all natural numbers m for which 
n + m is defined. Note that 0 e M by part (i). Also note that for all k £ No, s(k) £ M 
whenever k £ M by part (ii). This shows that M = No. Since n was arbitrary, this 
allows us to conclude that n + m is defined for all n , m e No- 

We read n + m as n plus m. The operation + is also called addition. 

Among the natural numbers, the successor of zero plays a very important role, so 
important that it deserves its own special symbol. Here we follow tradition and call 
the natural number s(0) one and denote it by 1. Note that for every natural number n, 
we have n + 1 = n + s(0) = s(n). In particular, 0 + 1 = 1. 

With this notation, the Principle of Induction can be restated in the following form. 

Principle B.14 (Principle of Induction). Let M c No- Then M = No if and only if 

a 0 £ M; and 

b Vke N 0 (k £ M) =+> (k + 1 e M). 

Theorem B.15 (Associative Property of Addition), m + (n + p) = ( m + n) + p, for all 
m,n,p e No. 

Proof. Let m,n £ No- Then let M denote the set of all natural numbers p for which 
m + (n + p) = (m + n) + p. We show that M = Nq. 
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Note that 

m + (n + 0) = m + n = (m + n) + 0 

which shows that OeM. 

Now assume that k £ M, i.e., m +(n +k) = (m +n) +k. Then 

m + [n+(k + 1)] = m + [(n+k) + 1] = \m+(n+k)\ + 1 = [(m + n)+k] + 1 = (m+n) + (fc + l). 

Notice here that the first, second, and fourth equalities follow from the second part of 
the definition of addition while the third uses our inductive assumption that m + ( n + 
k) = ( m + n) + k). This shows that k + 1 e M. Therefore, M = Nq. Since m and n were 
arbitrary elements of No, the theorem follows. □ 

In proofs to follow, we will trim out some of the wording and leave only the essential 
mathematical steps intact. In particular, we will (i) omit reference to the set M, and 
(ii) drop the phrase "For all k £ No" For example, to define addition, we will just write 
(i) n + 0 = n, and (ii) n + (k + 1) = (n + k) + 1. 

Lemma B.16. m + (n + 1) = (m + 1) + n,for all m, n £ No- 

Proof. Fix m £ Nq. Then 


m + (0 + 1) = m + 1 = (m + 0) + 1. 

Now assume that m + (k + 1) = (m + 1) + k. Then 

m + [(k + 1) + 1] = [m + (k + 1)] + 1 = [(/« + 1) + k] + 1 = (m + 1) + (k + 1). □ 

We next prove the commutative property, a task that takes two steps. First, we prove 

the following special case. 

Lemma B.17. n + 0 = 0 + n = n,for all n e No- 

Proof. The statement is trivially true when n = 0. Now suppose that k+0 = 0 + k = k 
for some k e No- Then 

{k + l) + 0 = k + l =(0 + k) + l =0 + (k + l). □ 

Theorem B.18 (Commutative Law of Addition), m + n = n + mfor all m, n e No. 

Proof. Letwz £ No. Thenm+0 = 0+m from the preceding lemma. Assume m+k = k+m. 
Then 

m + (k + 1) = (m + k) + 1 = (k + m) + 1 = k + (m + 1) = (k + 1) + m. □ 
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Lemma B.19. lfm,n e No and m + n = 0, then m = n = 0. 

Proof. Suppose that either of m and n is not zero. Since addition is commutative, we 
may assume without loss of generality that n + 0. Then there exists a natural number p 
so that n = s (p). This implies that m + n = m+s(p) = s(m+p) = 0, which is impossible 
since 0 is not the successor of any natural number. □ 

Theorem B.20 (Cancellation Law of Addition). Ifm,n,p e No and m +p = n + p, then 
m = n. 

Proof. Let m,n e Nq. Suppose that m + 0 = n + 0. Then m = n. Now suppose that 
m = n whenever m + k = n + k. If m + (k + 1) = n + (k + 1), then 

s(m + k) = (m + k) + 1 = m + (k + 1) = n + (k + 1) = (n + k) + 1 = s(n + k). 

Since s is an injection, this implies m +k = n +k. Thus m = n. □ 


B.8 Multiplication as a Binary Operation 

We define a binary operation X, called multiplication, on the set of natural numbers. 
When m and n are natural numbers, m X n is also called the product of in and n, and 
it sometimes denoted m * n and even more compactly as inn. We will use this last 
convention in the material to follow. Let n e No- We define 

i nO = 0, and 

ii n(k + 1) = nk + n. 

Note that 10 = 0 and 01 = 00 + 0 = 0. Also, note that 11 = 10 + 1 = 0 + 1 = 1. More 
generally, from (ii) and Lemma B.19, we conclude that if m,n + 0, then mn + 0. 

Theorem B.21 (Left Distributive Law). m(n + p) = mn + mp,for all m, n,p e No. 

Proof. Let m,n e No. Then 

m(n + 0) = mn = mn + 0 = mn + m 0. 

Now assume m(n + k) = mn + mk. Then 

m[n + (k + 1)] = m[(n + k) + 1] = m(n + k) + m 

= (mn + mk) + m = mn + (mk + m) = mn + m(k + 1). □ 

Theorem B.22 (Right Distributive Law), (m +n)p = mp + np,for all m,n,p e Nq. 
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Proof. Let m,n e No- Then 

( m + n) 0 = 0 = 0 + 0 = mO + nO. 

Now assume ( m + n)k = mk + nk. Then 

(m + n)(k + 1) = ( m + n)k + ( m + n) = (mk + nk) + (m + n) 

= (mk + m) + (nk + n) = m(k + 1) + n(k + 1). □ 

Theorem B.23 (Associative Law of Multiplication). m(np) = (mn)p , for all m , n , p e 
N 0 . 

Proof. Let m,n e No- Then 

m(n0) = mO = 0 = (mn) 0. 

Now assume that m(nk) = (mn)k. Then 

m[n(k + 1)] = m(nk + n) = m(nk) + mn = (mn)k + mn = (mn)(k + 1). □ 

The commutative law requires some preliminary work. 

Lemma B.24. nO = On = 0, for all n e No. 

Proof. The lemma holds trivially when n = 0. Assume kO = 0k = 0. Then 

(k + 1)0 = 0 = 0 + 0 = 0k + 0 = 0(k + 1). □ 

Lemma B.25. nl = In = n,for every n e No. 

Proof. 01 = 00 + 0 = 0 = 10. Assume £1 = 1^= k. Then 

(k + l)l =kl + 11 = lfc + 1 = l(fc + l). □ 

Theorem B.26 (Commutative Law of Multiplication), mn = nm,for all m, n e No- 
Proof. Let m e No- Then mO = 0 m. Assume mk = km. Then 

m(k + 1) = mk + m = km + m = km + 1 m = (k + 1 )m. □ 
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B.9 Exponentiation 

We now define a binary operation called exponentiation which is defined only on 
those ordered pairs ( m , n ) of natural numbers where not both are zero. The notation 
for exponentiation is non-standard. In books, it is written m n while the notations m**n, 
m A n and exp(«z, n ) are used in-line. We will use the m" notation for the most part. 

When m = 0, we set 0” = 0 for all n e No with n i= 0. Now let m + 0. We define m n 
by (i) m° = 1 and (ii) m k+1 = mm k . 

Theorem B.27. For all m,n,p e No ivith m + 0, m n+f) = m n m p . 

Proof. Let m,n e No with m + 0. Then m n+0 = m n = m n 1 = m n m°. Now suppose 
that m n+k = m" m k . Then 

m n+(k+ 1 ) _ m (n+k )+ 1 _ m m n+k _ m ( m n = m n (m m k ) = m n V l k+1 . □ 

Theorem B.28. For all m,n,p e Nq with m + 0, (m”) p = m np . 

Proof. Let m,n e No with m + 0. Then (m”)° = 1 = m° = m n0 . Now suppose that 
( m n ) k = m nk . Then 


(; m n ) k+1 = m n (m n ) k = m n (m nk ) = m n+nk = m n(k+1) . □ 

B.10 Partial Orders and Total Orders 

A binary relation R on a set X is just a subset of the cartesian product X X X. In dis- 
cussions of binary relations, the notation (x, y) € R is sometimes written as xRy. 

A binary relation R is: 

i reflexive if (x, x) e R for all x e X. 

ii antisymmetric if x = y whenever (x, y) e R and (y, x) e R, for all x, y e X. 

iii transitive if (x, y) e R and (y, z) e R imply (x, z) e R, for all x,y,z e X. 

A binary relation R on a set X is called a partial order on X when it is reflexive, 
antisymmetric, and transitive. Traditionally, symbols like < and C are used to denote 
partial orders. As an example, recall that if X is a family of sets, we write A c B when 
A is a subset of B. 

When using the ordered pair notation for binary relations, to indicate that a pair 
(x, y) is not in the relation, we simply write (x, y) i R. When using the alternate 
notation, this is usually denoted by using the negation symbol from logic and writing 
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-i(xRy). Most of the special symbols used to denote partial orders come with negative 
versions, e.g., x f y , x $£ xj . 

A partial order is called a total order on X when for all x,y £ X, (x, y) £ R or 
( y ,x ) £ R. For example, if 

X = {0,{0},{0,{0}}} 

then C is a total order on X. 

When < is a partial order on a set X, we write x < y when x < y and x + y. 


B.ll A Total Order on Natural Numbers 

Let m, n £ No- Define a binary relation < on No by setting m < n if and only if there 
exists a natural number p so that m + p = n . 

Proposition B.29. < is a total order on No- 

Proof. < is reflexive since n + 0 = n and therefore n < n, for all ri e Mo. Next, we show 
that < is antisymmetric. Let m,n £ Nq and suppose that m < n and n < m. Then 
there exist natural numbers p and q so that m + p = n and n + q = m . It follows that 

m + (p + q) = (m+p) + q = n+ q = m = m + 0 

Therefore p + q = 0, which implies that p = q = 0. Thus m+p = m+ 0 = m = n. 

Next, we show that < is transitive. Suppose that m,n,p e Nq, m < n and n < p. 
Then there exist natural numbers q and r so that m + q = n and n + r = p. Then 

m + (q + r) = (m + q) + r = n + r = p . 

Thus m < p, and we have now shown that < is a partial order on No- 

Finally, we show that < is a total order. To accomplish this, we choose an arbitrary 
element m e No and show that for every n £ No, either m < n or n < m. We do this 
by induction on n. Suppose first that n =0. Since 0 + m = m, we conclude that 0 < m. 
Now suppose that for some k £ No, we have m < k. Then there is a natural number p 
so that m + p = k. Then m + (p + 1) = (m + p) + 1 = k + 1, so m < k + 1. 

On the other hand, suppose that for some k £ No, we have k < m. If fc = m, then 
m < k and m < k + 1 as above. Now suppose that k < m and k + m. Since k < m, there 
exists a natural number p so that k + p = m. Since k + m, we know p + 0. Therefore, 
there is a natural number q so that p = q + 1. Then m =k+p = k + (q + 1) = (k + 1) + q 
which shows that k + 1 < m. □ 

Note that if m, n £ No, then in < n if and only if there exists a natural number p + 0 
so that m +p = n. 
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Theorem B.30 (Monotonic Law for Addition). Let m,n,p £ No- If m < n, then m+p < 
n + p. Furthermore, if m < n, then m + p < n + p. 

Proof It suffices to prove that if m,n £ No with m < n, then m + p < n + p for every 
p e No- Let q + 0 be the natural number so that m + q = n. Now let p e No. Then 

(m + p) + q = (m + q) + p = n + p, so m+p < n + p. □ 

Lemma B.31. If m,n £ No, m + 0 and n + 0, then mn + 0. 

Proof. Assume to the contrary, that m, n £ No, m i= 0, n + 0 and mn = 0. Let n = s(p). 

Then 0 = mn = ms(p) + m which requires m = 0. This is a contradiction. □ 

Theorem B.32 (Monotonic Law for Multiplication). Let m, n,p £ No- If m < n, then 
mp < np. Furthermore, ifm<n and p i= 0, then mp < np. 

Proof. Only the last statement requires proof. Let m, n £ No with m < n. Then m+q = 
n for some q + 0. Then np = (m + q)p = mp + pq. Since pq + 0, we conclude 
mp < np. □ 

Corollary B.33 (Cancellation Law of Multiplication). If m,n,p £ No, mp = np, and 
p + 0, then m = n. 

Proof. If m < n, then mp < np, and if n < m, then np < mp. We conclude that 
m = n. □ 


B.12 Notation for Natural Numbers 

In some sense, we already have a workable notation for natural numbers. In fact, we 
really didn't need a special symbol for s(0). The natural number 0 and the sucessor 
function s are enough. For example, the positive integer associated with the number 
of fingers (including the thumb) on one hand is s(s(s(s(s(0))))), our net worth is 0, and 
the age of Professor Trotter's son in years when this section was first written was 

s (s (s (s (s (s (s (s (s (s (s (s (s (s (s (s (s (s (0)))))))))))))))))) . 

Admittedly, this is not very practical, especially if some day we win the lottery or want 
to discuss the federal deficit. So it is natural (ugh!) to consider alternative notations. 

Here is one such scheme. First, let's decide on a natural b > s(0) as base. We will 
then develop a notation which is called the base b notation. We already have a special 
symbol for zero, namely 0, but we need additional symbols for each natural number 
n with 0 < n < b. These symbols are called digits. For example, the positive integer 
b = s(s(s(s(s(s(s(s(0)))))))) is called eight, and it makes a popular choice as a base. 
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Here are the symbols (digits) customarily chosen for this base: 1 = s(0), 2 = s(l); 
3 = s(2); 4 = s(3); 5 = s(4); 6 = s(5); and 7 = s(6). Technically speaking, it is not 
necessary to have a separate symbol for b, but it might be handy regardless. In this 
case, most people prefer the symbol 8. We like this symbol, unless and until it gets 
lazy and lays down sideways. 

So the first 8 natural numbers are then 0, 1, 2, 3, 4, 5, 6 and 7. To continue with our 
representation, we want to use the following basic theorem. 

Theorem B.34. Let n, d e No with d > 0. Then there exist unique natural numbers q and r 
so that n = qd + r and 0 < r < d. 

Proof. Let d e No with d > 0. We first show that for each n e No, there exists q,r e No 

so that n = qd + r and 0 < r < d. If n = 0, we can take q = 0 and r = 0. Now suppose 

that k = qd + r and 0 < r < m for some k e No. 

Note that r < d implies r + 1 < d. If r + 1 < d, then k + 1 = qd + (r + 1). On the other 

hand, if r + 1 = d, then k + 1 = (q + 1 )d + 0. 

Now that existence has been settled, we note that the uniqueness of q and r follow 
immediately from the cancellation properties. □ 

Now suppose that for some k e No, with k > 7, we have defined a base eight no- 
tation for the representation of k, for all n with 0 < n < k, and that in each case, 
this representation consists of a string of digits, written left to right, and selected from 
{0,1,2, 3,4, 5, 6, 7}. Write k + 1 = qb + r where 0 < r < b. Note that q < k, so that 
we already have a representation for q. To obtain a representation of k + 1, we simply 
append r at the (right) end. 

For example, consider the age of Professor Trotter's son. It is then written as 22. And 
to emphasize the base eight notation, most people would say 22, base 8 and write (22)g. 

Among the more popular bases are base 2, where only the digits 0 and 1 are used, 
and base sixteen, where sixteen is the popular word for (20)s. Here the digit symbols 
are 

0, 1, 2, 3, 4, 5, 6, 7, 8, 9, A, B, C, D, £, F 

Another popular choice, in fact the one in most widespread use in banks, shopping 
centers and movie theatres, is base ten. Ten is the natural number A, base sixteen. 
Also, ten is (12)s. Most folks use the digits 0, 1, 2, 3, 4, 5, 6, 7, 8, 9 for base ten notation. 
And when no other designation is made, then it is assumed that the natural number is 
written base ten. So of course. Professor Trotter's son is 18 and is a freshman at Georgia 
Tech. Which explains why his hair is as white as it is. 

For any base b > 1, caution must be exercised when discussing multiplication, since 
writing the product m X n in the abbreviated form m n causes us some grief. For ex- 
ample, if b = 8, then writing the product 372 X 4885 as 3724885 is ambiguous. For this 
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reason, when using base b notation, the product symbol X (or some variation of X) is 
always used. 


B.12.1 Alternate Versions of Induction 

Many authors prefer to start the development of number systems with the set of pos- 
itive integers and defer the introduction of the concept of zero. In this setting, you 

have a non-empty set N, a one-to-one successor function s : N — > N and a positive 
integer called one and denoted 1 that is not the successor of any positive integer. The 
Principle of Induction then becomes: If M C IN, then M = N if and only if 

ale M; and 

b VA: e N 0 (k e M) => (s(fc) e M). 

More generally, to show that a set M contains all integers greater than or equal to 
an integer n , it is sufficient to show that (i) n £ M, and (ii) For all k £ Z, (k £ M => 
(k + 1 £ M). 

Here is another version of induction, one that is particularly useful in combinatorial 
arguments. 

Theorem B.35. Let M c N. f/M + N, then there is a unique least positive integer n that 
does not belong to M. 


B.13 Equivalence Relations 

A binary relation R is symmetric if ( x , y) £ R implies (y, x) £ R for all x, y £ X. 

A binary relation Rona set X is called an equivalence relation when it is reflexive, 
symmetric, and transitive. Typically, symbols like, =, =, = and ~ are used to denote 
equivalence relations. An equivalence relation, say =, defines a partition on the set X 
by setting 

{x) = {y £X:x = y}. 

Note that if x, y £ X and ( x ) Pi (y) + 0, then ( x ) = (y). The sets in this partition are 
called equivalence classes. 

When using the ordered pair notation for binary relations, to indicate that a pair 
(x, y) is not in the relation, we simply write (x, y) £ R. When using the alternate 
notation, this is usually denoted by using the negation symbol from logic and writing 
-i(xXy). Many of the special symbols used to denote equivalence relations come with 
negative versions: x i= y, x & y, x + y, etc. 
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B.14 The Integers as Equivalence Classes of Ordered 
Pairs 

Define a binary relation = on the set Z = No X No by 

(, a,b) = (c,d ) iff a + d = b + c. 

Lemma B.36. = is reflexive. 

Proof. Let (a, b) e Z. Then a + b = b + a, so (a, b) = (b, a). □ 

Lemma B.37. = is symmetric. 

Proof. Let (a, b), (c, d) e Z and suppose that (a, b) = (c, d). Then a + d = b + c, so that 
c + b = d + a. Thus (c, d) = {a, b). □ 

Lemma B.38. = is transitive. 

Proof. Let ( a , b), ( c , d), ( e , f) e Z. Suppose that 

(a,b) = (c,d) and ( c,d) = (e,f ). 

Then a + d = b + c and c + / = d + e. Therefore, 

(a + d) + (c + f) = (b + c) + (d + e). 

It follows that 

(a + f) + (c + d) = (b + e) + (c + d). 

Thus a + f = b + e so that (a, b) = (e,f). □ 

Now that we know that = is an equivalence relation on Z, we know that = partitions 
Z into equivalence classes. For an element (a, b) e Z, we denote the equivalence class 
of (a, b) by {(a, b)). 

Let Z denote the set of all equivalence classes of Z determined by the equivalence 
relation =. The elements of Z are called integers. 


B.15 Properties of the Integers 

For the remainder of this chapter, most statements will be given without proof. Stu- 
dents are encouraged to fill in the details. 

We define a binary operation + on Z by the following rule: 

(( a , b)) + ((c, d)) - ((a + c,b + d)). 
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Note that the definition of addition is made in terms of representatives of the class, so 
we must pause to make sure that + is well defined, i.e., independent of the particular 
representatives . 

LemmaB.39. If((a,b)) = ((c , d)) and {{e , /)) = ((g r h)) r then((a,b))+((e,f)) = (( c,d)) + 

{(g.m 

Proof. Since ( a,b ) = (c,d), we know a + d = b + c. Since ( e,f ) = (g,h), we know 
e + h = f + g. It follows that (a + d) + (e + h ) = (b + c) + (/ + g). Thus (a + e) + (d + h ) = 
(b + f) + (c + g), which implies that ((a, b)) + {{e, /)) = ((c, d)) + {(g, h )). □ 

In what follows, we use a single symbol, like x, y or z to denote an integer, but 
remember that each integer is in fact an entire equivalence class whose elements are 
ordered pairs of natural numbers. 

Theorem B.40. For all x,y,z e Z, 

1. x + y = y + x; 

2. x + (y + z) = (x + y) + z; and 

3. x + y = x + z implies y = z. 

Next, we define a second binary operation called multiplication, and denoted iXy, 
x * y or just xy. When x = ((a, b )) and y = ((c, d)), we define: 

xy = ((a, b))((c, d)) = (( ac + bd, ad + be)). 

Theorem B.41. Multiplication is well defined. Furthermore, 

1. xy = yx,for every x, y e Z. 

2. x{yz) = ( xy)z,for every x, y , z e Z. 

3. x{y + z) = xy + xz,for every x,y,z e Z. 

The integer ((0, 0)) has a number of special properties. Note that for all x e Z, 
x + ((0, 0)) = x and x((0, 0)) = ((0, 0)). So most folks call ((0, 0)) zero and denote it 
by 0. This is a terrible abuse of notation, since we have already used the word zero and 
the symbol 0 to denote a particular natural number. 

But mathematicians, computer scientists and even real people do this all the time. 
We use the same word and even the same phrase in many different settings expecting 
that the listener will make the correct interpretation. For example, how many different 
meanings do you know for You're so bad ? 


346 



B.15 Properties of the Integers 


Ifx = ((a, b)) is an integer and y = ((b,a)), thenx + y = (( a+b,a+b )) = 0. The integer 
y is then called the additive inverse of x and is denoted —x. The additive inverse of x 
is also called minus x. The basic property is that x + (— x) = 0, for every x e Z. 

We can now define a new binary operation, called subtraction and denoted on 
Z by setting x — y = x + (— y). In general, subtraction is neither commutative nor 
associative. However, we do have the following basic properties. 

Theorem B.42. For all x,y,z e Z, 

1. x(-y) = -xy; 

2. x(y - z) = xy - xz; and 

3. -ix-y) = y- x. 

Next, we define a total order on Z by setting x < y in Z when x = ((a, b )), y = ((c, d)) 
and a + d < b + c in Nq. 

Theorem B.43 (Monotonic Law for Addition). Letx,y,z E Z. Ifx < y,thenx+z < y+z. 
Furthermore, ifx < y, then x + z < y + z. 

For multiplication, the situation is more complicated. 

Theorem B.44 (Monotonic Law for Multiplication). Let x, y, z E Z. If x < y, then 

1. xz < yz, ifz > 0, 

2. xz = yz = 0, ifz = 0, and 

3. xz > yz, ifz < 0. 

Now consider the function / : Nq — » Z defined by f(n) = (in , 0)). It is easy to 
show that f is an injection. Furthermore, it respects addition and multiplication, i.e., 
f(n + m) = f(n ) + f(m) and f(nm ) = f(n)f(m). Also, note that if x E Z, then x > 0 if 
and only if x = f(n) for some n E No- So, it is customary to abuse notation slightly and 
say that No is a "subset" of Z. Similarly, we can either consider the set N of positive 
integers as the set of natural numbers that are successors, or as the set of integers that 
are greater than 0. 

When n is a positive integer and 0 is the zero in Z, we define 0" = 0. When x E Z, 
x + 0 and n E No, we define x n inductively by (i) x° = 1 and x k+1 = xx k . 

Theorem B.45. If x E Z, x + 0, and m, n E Nq, then x m x n = x m+m and ( x m ) n = x mn . 
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B.16 Obtaining the Rationals from the Integers 

We consider the set Q of all ordered pairs in Z X Z of the form (x, y) with y + 0. Ele- 
ments of Q are called rational numbers, or fractions. Define an equivalence relation, 
denoted =, on Q by setting (x, y) = (z, w) if and only if xiv = yz. Here we should point 
out that the symbol = can be used (and often is) to denote an equivalence relation. It 
is not constrained to mean "identically the same." 

When q = (x, y) is a fraction, x is called the numerator and y is called the denomi- 
nator of q. Remember that the denominator of a fraction is never zero. 

Addition of fractions is defined by 

(a, b ) + (c, d) = (ad + be, bd), 

while multiplication is defined by 

(a, b)(c, d) = (ac, bd). 

As was the case with integers, it is important to pause and prove that both operations 
are well defined. 

Theorem B.46. Let x, y, z, zv e Q. If x = y and z = w, then x + z = y + iv and xz = yiv. 

Addition and multiplication are both associative and commutative. Also, we have 
the distributive property. 

Theorem B.47. Let x,y,z e Q. Then 

1. x + y = y + x and xy = yx. 

2. x + (y + z) = (x + y) + z and x(yz) = (xy) z. 

3. x(y + z) = xy + xz. 

The additive inverse of a fraction (a, b) is just (—a, b). Using this, we define subtrac- 
tion for fractions: (a, b) - (c, d) = (a, b) + (-c, d). 

When (a, b) is a fraction, and a + 0, the fraction (b, a) is the reciprocal of (a, b). The 
reciprocal is also called the multiplicative inverse, and the reciprocal of x is denoted 
x -1 . When y + 0, we can then define division by setting x/y = xy~ l , i.e., (a,b)/(c, d) = 
(ad, be). Of course, division by zero is not defined, a fact that you probably already 
knew! 

As was the case for both No and Z, when n is a positive integer, and 0 is the zero in 
Q, we define 0" = 0. When x = (a,b) is a fraction with x + 0 and n is a non-negative 
integer, we define x n inductively by (i) x° = 1 and (ii) OC. 3C OC. • 
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Theorem B.48. If x £ Q, x + 0, and m, n £ Z, then x m x n = x m+m and (x m ) n = x mn . 

Many folks prefer an alternate notation for fractions in which the numerator is writ- 
ten directly over the denominator with a horizontal line between them, so (2, 5) can 
also be written as 1. 

Via the map g(x) = (x, 1) = f, we again say that the integers are a "subset" of the 
rationals. As before, note that g(x + y) = g{x) + g(y), g(x - y) = g(x) - g(y) and 
g{xy) = g(x)g(y). 

In the third grade, you were probably told that 5 = y, but by now you are realizing 
that this is not exactly true. Similarly, if you had told your teacher that | and | weren't 
really the same and were only "equal" in the broader sense of an equivalence relation 
defined on a subset of the cartesian product of the integers, you probably would have 
been sent to the Principal's office. 

Try to imagine the trouble you would have gotten into had you insisted that the real 
meaning of \ was 

^ = ((((s(s(0)),s(0))),((s(s(0)),0)») 

We can also define a total order on Q. To do this, we assume that (a, b ), (c, d) £ Q have 
b,d > 0. (If b < 0, for example, we would replace it by ( a ' , b') = (-a, -b), which is in 
the same equivalence class as (a, b) and has b' > 0.) Then we set (a, b) < (c, d) in Q if 
ad < be in Z. 

B.16.1 Integer Exponents 

When n is a positive integer and 0 is the zero in Q, we define 0" = 0. When x £ <Q, 
x + 0 and n £ No, we define x 11 inductively by (i) x° = 1 and x k+1 = xx k . When n e Z 
and n < 0, we set x n = l/x~ n . 

Theorem B.49. Ifx £ Q, x + 0, and m, n e Z, then x m x n = x m+m and (x m ) n = x mn . 


B.17 Obtaining the Reals from the Rationals 

A full discussion of this would take us far away from a discrete math class, but let's at 
least provide the basic definitions. A subset S C Q of the rationals is called a cut (also, 
a Dedekind cut), if it satisfies the following properties: 


1. 0 + S + Q, i.e, S is a proper non-empty subset of Q. 

2. x £ S and y < x in Q implies y £ S, for all x, y £ Q. 

3. For every x £ S, there exists y £ S with x < y, i.e., S has no greatest element. 


349 



Appendix B Background Material for Combinatorics 


Cuts are also called real numbers, so a real number is a particular kind of set of 
rational numbers. For every rational number q, the set q = {p £ Q : p < q} is a cut. 
Such cuts are called rational cuts. Inside the reals, the rational cuts behave just like the 
rational numbers and via the map h(q) = q, we abuse notation again (we are getting 
used to this) and say that the rational numbers are a subset of the real numbers. 

But there are cuts which are not rational. Here is one: {p £ Q : p < 0} U {p £ Q : 
p 2 < 2}. The fact that this cut is not rational depends on the familiar proof that there 
is no rational q for which q 2 = 2. 

The operation of addition on cuts is defined in the natural way. If S and T are cuts, 
set S + T = {s + t : s e S, f £ T}. Order on cuts is defined in terms of inclusion, i.e., 
S < T if and only if S C T. A cut is positive if it is greater than 0. When S and T are 
positive cuts, the product ST is defined by 

ST = 0 U { s f : s £ S , t £ T, s > 0 , f > 0 }■ . 

One can easily show that there is a real number r so that r 1 = 2. You may be surprised, 
but perhaps not, to learn that this real number is denoted V2. 

There are many other wonders to this story, but enough for one day. 


B.18 Obtaining the Complex Numbers from the Reals 

By now, the following discussion should be transparent. The complex number system 
C is just the cartesian product RxR with 

1. ( a , b) = (c, d) in C if and only if a = c and b = d in R. 

2. ( a , b ) + (c, d) = (a + c,b + d). 

3. (a, b)(c, d) = ( ac - bd, ad + be). 

Now the complex numbers of the form ( a , 0) behave just like real numbers, so is nat- 
ural to say that the complex number system contains the real number system. Also, 
note that (0, l) 2 = (0, 1)(0, 1) = (-1, 0), i.e., the complex number (0, 1) has the property 
that its square is the complex number behaving like the real number -1. So it is con- 
venient to use a special symbol like / for this very special complex number and note 
that i 2 = -1. 

With this beginning, it is straightforward to develop all the familiar properties of the 
complex number system. 
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B.18.1 Decimal Representation of Real Numbers 

Every real number has a decimal expansion — although the number of digits after the 
decimal point may be infinite. A rational number q = m/ m from Q has an expansion 
in which a certain block of digits repeats indefinitely For example, 

nocq 

— — = 81.6857142857142857142857142857142857142857142 . . . 


In this case, the block 857142 of size 6 is repeated forever. 

Certain rational numbers have terminating decimal expansions. For example, we 
know that 385/8 = 48.125. If we chose to do so, we could write this instead as an 
infinite decimal by appending trailing 0's, as a repeating block of size 1: 


— = 48.1250000000000000000000000000000000 . . . 
8 


On the other hand, we can also write the decimal expansion of 385/8 as 


385 

8 


= 48.12499999999999999999999999999999999 . . . 


Here, we intend that the digit 9, a block of size 1, be repeated forever. Apart from this 
anomaly, the decimal expansion of real numbers is unique. 

On the other hand, irrational numbers have non-repeating decimal expansions in 
which there is no block of repeating digits that repeats forever. 

You know that V2 is irrational. Here is the first part of its decimal expansion: 


V2 = 1.41421356237309504880168872420969807856967187537694807317667973. . . 


An irrational number is said to be algebraic if it is the root of polynomial with integer 
coefficients; else it is said to be transcendental. For example, V2 is algebraic since it is 
the root of the polynomial x 2 - 2. 

Two other famous examples of irrational numbers are tc and e . Here are their deci- 
mal expansions: 

n = 3.14159265358979323846264338327950288419716939937510582097494459 . . . 


and 


e = 2.7182818284590452353602874713526624977572470936999595749669676277. . . 
Both 7i and e are transcendental. 
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Example B.50. Amanda and Bilal, both students at a nearby university, have been 
studying rational numbers that have large blocks of repeating digits in their decimal 
expansions. Amanda reports that she has found two positive integers m and n with 
n < 500 for which the decimal expansion of the rational number m/n has a block of 
1961 digits which repeats indefinitely. Not to be outdone, Bilal brags that he has found 
such a pair s and t of positive integers with t < 300 for which the decimal expansion of 
s/t has a block of 7643 digits which repeats indefinitely. Bilal should be (politely) told 
to do his arithmetic more carefully, as there is no such pair of positive integers (Why?). 
Qn the other hand, Amanda may in fact be correct — although, if she has done her work 
with more attention to detail, she would have reported that the decimal expansion of 
m/n has a smaller block of repeating digits (Why?). 

Proposition B.51. There is no surjection from N to the set X = {x e R : 0 < x < 1}. 

Proof. Let / be a function from N to X. For each n e N, consider the decimal expan- 
sion^) of the real number f(n). Then choose a positive integer a n so that (1) a„ < 8, 
and (2) a n is not the n th digit after the decimal point in any decimal expansion of /(«). 
Then the real number x whose decimal expansion is x = .ti \ ... is an element of 
X which is distinct from f(n), for every n e N. This shows that / is not a surjection. □ 


B.19 The Zermelo-Fraenkel Axioms of Set Theory 

In the first part of this appendix, we put number systems on a firm foundation, but in 
the process, we used an intuitive understanding of sets. Not surprisingly, this approach 
is fraught with danger. As was first discovered more than 100 years ago, there are major 
conceptual hurdles in formulating consistent systems of axioms for set theory. And it 
is very easy to make statements that sound "obvious" but are not. 

Here is one very famous example. Let X and Y be sets and consider the following 
two statements: 

1. There exists an injection / : X — > Y. 

2. There exists a surjection g : Y — » X. 

If X and Y are finite sets, these statements are equivalent, and it is perhaps natural 
to surmise that the same is true when X and Y are infinite. But that is not the case. 

Here is the system of axioms popularly known as ZFC, which is an abbreviation for 
Zermelo-Fraenkel plus the Axiom of Choice. In this system, the notion of set and the 
membership operator e are undefined. However, if A and B are sets, then exactly one 
of the following statements is true: (i) A e B is true-, (ii) A e B is false. When A e B is 
false, we write A £ B. Also, there is an equivalence relation = defined on sets. 
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Axiom B.52 (Zermelo-Fraenkel Axioms with Axiom of Choice). 

Axiom of extensionality Tzvo sets are equal if and only if they have the same elements. 

Axiom of empty set There is a set 0 with no elements. 

Axiom of pairing If x and y are sets, then there exists a set containing x and y as its only 
elements, which we denote by {x, y}. Note: If x = y, then we write only {x}. 

Axiom of union For any set x, there is a set y such that the elements of y are precisely the 
elements of the elements ofx. 

Axiom of infinity There exists a set x such that 0 e x and whenever y e x, so is {y , {y}}. 

Axiom of power set Every set has a power set. That is, for any set x, there exists a set y, 
such that the elements of y are precisely the subsets ofx. 

Axiom of regularity Every non-empty set x contains some element y such that x and y are 
disjoint sets. 

Axiom of separation (or subset axiom) Given any set and any proposition P(x), there is 
a subset of the original set containing precisely those elements xfor which P(x) holds. 

Axiom of replacement Given any set and any mapping, formally defined as a proposition 
P(x, y) where P(x, y{) and P(x, yf) implies y\ = yz, there is a set containing precisely 
the images of the original set's elements. 

Axiom of choice Given any set of mutually exclusive non-empty sets, there exists at least one 
set that contains exactly one element in common with each of the non-empty sets. 

A good source of additional (free) information on set theory is the collection of 

Wikipedia articles. Do a web search and look up the following topics and people: 

1 . Zermelo-Fraenkel set theory. 

2. Axiom of Choice. 

3. Peano postulates. 

4. Georg Cantor, Augustus De Morgan, George Boole, Bertrand Russell and Kurt 
Godel. 
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List of Notation 


Symbol 

Description 

Page 

n\ 

n factorial 

20 

P(m, n) 

number of permutations 

20 

© 

binomial coefficient 

21 

C(n,k ) 

binomial coefficient (inline) 

21 

(h,k2,h,-,0 

multinomial coefficient 

30 

V 

polynomial time problems 

65 

Nr 

nondeterministic polynomial time problems 

66 

deg G (z’) 

degree of vertex v in graph G 

70 

K„ 

complete graph on n vertices 

71 

In 

independent graph on n vertices 

71 

P„ 

path with n vertices 

71 

C n 

path with n vertices 

71 

X(G) 

chromatic number of a graph G 

81 

co( G) 

clique number of G 

84 

*11 y 

x and y are incomparable 

118 

height(P) 

height of poset P 

119 

width(P) 

width of poset P 

119 

D(x), D(S), D[x] r D[S] 

down set 

124 

U(x), U(S), U[x], IT[S] 

up set 

124 

n 

chain with n points 

128 

P + Q 

disjoint sum of posets 

129 

(pin) 

Euler <p function 

149 

0 

generalized binomial coefficient 

163 

A f{n) 

advancement operator applied to fin) 

184 


(Continued on next page) 
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Symbol 

Description 

Page 

P(A\B) 

probability of A given B 

210 

C(X,k ) 

family of all /c-element subsets of X 

223 

R(m, n ) 

Ramsey number 

224 

(C) 

equivalence class of C 

294 

stabG(C) 

stabilizer of C under action of G 

294 

E 

complement of event E 

320 

X £ X 

x is a member of the set X 

327 

xiX 

x is not a member of the set X 

327 

xn Y 

intersection of X and Y 

328 

XU Y 

union of X and Y 

329 

0 

empty set 

330 

N 

set of positive integers 

330 

Z 

set of integers 

330 

Q 

set of rational numbers 

330 

R 

set of real numbers 

330 

No 

set of non-negative integers 

330 

[«] 

{1,2, , n} 

330 

X c Y 

X is a subset of Y 

330 

X c Y 

X is a proper subset of Y 

330 

Xx Y 

cartesian product of X and Y 

331 

/: X -4 Y 

/ is a function from X to Y 

332 

/ : X —* Y 

/ is an injection from X to Y 

332 

f : X » Y 

onto 

/ is a surjection from X to Y 

332 

/: X -i-U Y 

onto 

/ is a bijection from X to Y 

332 

|X| 

cardinality of set X 

333 
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absorbing 

Markov chain, 315 
state of a Markov chain, 315 
addition 

formal definition of, 336 
adjacent vertices, 69 
algorithm 

on-line, 309 
polynomial time, 65 
alphabet, 17 
antichain, 119 
antisymmetric, 340 
arithmetic progression, 319 
array, 17 
automorphism 
of poset, 120 

basis step, 51 
Bernoulli trials, 211 
big Oh notation, 63 
bijection, 332 

binomial coefficient, 21, 25, 29 
formula for, 21 
generalized, 163 
identity involving, 24, 25 
recursive formula for, 42 
binomial theorem, 29 
Newton's, 163 
bit string, see string, binary 

capacity 

of a cut, 255 
of an edge, 253 


cardinality, 333 
cartesian product, 331 
Catalan number, 27 
Cayley's formula, 97 
certificate, 62 
chain, 119 
chain partition, 278 
characters, 17 
chromatic number, 81, 228 
circuit, 76 
clique, 84 

maximum size, 84 
clique number, 84 
Collatz sequence, 9 
coloring 

proper, 81 
combination, 21 
number of 

formula for, 21 
comparable, 118 
complex number 

formal definition of, 350 
component, 73 
of poset, 120 
connected 

poset, 120 

conservation law, 254 
cover, 115 
cut, 255 

Dedekind, 349 
cycle, 71 

directed, 239 
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cycle index, 297 

degree of a vertex, 70 
denominator, 348 
derangement, 147 
digraph, 239 
Dijkstra's algorithm, 240 
Dilworth's theorem, 122 
dual of, 122 
dimension, 139 
distance, 239 
divides, 45 
division theorem, 45 
divisor, 45 

common, 45 
greatest common, 45 
down set, 124 
drawing of a graph, 89 
planar, 89 
dual, 120 

edge, 69 

directed, 239 
multiple, 75 
element, 327 
embedding, 120 
equivalence classes, 344 
Erdos-Ko-Rado Theorem, 313 
Euclidean algorithm, 45 
Euler cp function, 149 
Euler's formula, 90 
eulerian 

circuit, 76 
trail, 105 
event, 209 

dependent, 21 1 
independent, 211 
expectation, 212 
expected value, see expectation 

face, 89 


factorial 

definition, 20 
recursive definition, 41 
Fibonacci 

numbers, 179 
sequence, 180, 183 
flow, 253 

value of, 254 

Ford-Fulkerson labeling algorithm, 

262 

forest, 73, 310 

full house (poker hand), 210 
function, 331 
injective, 59 
one-to-one, 59, 332 
onto, 332 

Gale-Ryser theorem, 319 
generating function, 157 

and solving recurrences, 198 
exponential, 167 
ordinary, 167 
girth, 108, 228 
graph, 69 

2-colorable, 82 
acyclic, 73 
bipartite, 83 
matching in, 274 
comparability, 118, 121 
complete, 70 
connected, 73 
cover, 115, 121 
directed, see digraph 
disconnected, 73 
eulerian, 75 
hamiltonian, 79 
incomparability, 118 
independent, 70 
intersection, 87 
interval, 87 
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labeled, 303 
oriented, 253 
perfect, 88 
planar, 89 
regular, 287 
shortest path in, 240 
simple, 75 
unlabeled, 303 

greatest common divisor, see divisor, 
greatest common 
Euler (p function, 149 
ground set, 114 
group, 290 

permutation, 290 
symmetric, 291 

hamiltonian 
cycle, 79 

Hasse diagrams, 116 
hat check problem, 147 
height, 119 
homeomorphic, 92 

incident to, 69 
incomparable, 118 
independent 
event, 211 

random variables, 216 
induction 

principle of mathematical, 49, 335 
strong, 54 

inductive hypothesis, 51 
inductive step, 51 
injection, 59, 332 
input size, 63 
integers 

formal definition of, 345 
positive, 344 
intersection, 328 
interval order, 128 


interval representation, 128 
distinguishing, 128 
inverse, 290 
isomorphism 
of graphs, 72 
of posets, 119 

Kruskal's algorithm, 237 

labeling algorithm, 262 
lattice, 126 

subset, 126 
lattice path, 26 
counting, 27 

number not crossing y = x, 27 
leaf, 74 
length, 239 

of arithmetic progression, 319 
of path or cycle, 71 
letter, 17 

linear diophantine equation, 46 
linear extension, 125, 134 
little oh notation, 64 
loop, 75 

Lovasz Local Lemma, 323 
asymmetric, 320 
symmetric, 322 

Markov chain, 314 
matching, 274 

maximum, 274 
stable, 316 
matrix 

stochastic, 314 
transition, 314 
zero-one, 317, 319 
maximal 

antichain, 123 
chain, 123 

points of a poset, 123 
maximum 
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antichain, 123 
chain, 123 

mean, see expectation 
membership, 327 
merge sort, 47 
minimal 

point of a poset, 122 
minimum weight spanning tree 
Kruskal's algorithm for, 237 
minimum weight spanning trees 
Prim's algorithm for, 238 
multigraph, 75 
multinomial coefficient, 30 
multinomial theorem, 30 
multiplicative inverse, 348 

natural numbers, 335 
neighbor, 70 

neighborhood (of a vertex), 70 
network, 253 
network flow, 253 

nondeterministic polynomial time, 66 
notes 

musical, 299 
numerator, 348 

octave, 300 
operation 

binary, 336 
operations, 62 
operator 

advancement, 184 
linear, 195 
or 

exclusive, 329 
inclusive, 329 
order 

linear, 118 
partial, 114, 340 
total, 118, 341 


on natural numbers, 341 
ordered pairs, 331 
outcomes, 209 

partially ordered set, 114 
partition 

antichain, 311 
dual, 318 

of an integer, 165, 319 
path, 71 

augmenting, 258 
directed, 239 
pattern inventory, 299 
Peano postulates, 335 
permutation, 20, 290 

cycle notation for, 291 
function, 143 
pigeon hole principle, 59 
generalized, 85 

planar drawing, see drawing of a 
graph, planar 
poset, 114 
potential, 262 
Prim's algorithm, 238 
principle of inclusion-exclusion, 145 
probability, 209 

conditional, 210 
measure, 209 
space, 208 
proof 

combinatorial, 23 
Priifer code, 97 
pseudo-alphabetic order, 261 

Ramsey number, 224, 322 
small, 225 
symmetric, 226 

Ramsey's theorem, 224, 227, 228 
random variable, 212 
rational numbers, 348 
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real number 

formal definition of, 350 
reciprocal, 348 
recurrence equation 

constant coefficients, 183, 185 
general solution, 187 
homogeneous, 183 
linear, 182 

nonconstant coefficients, 183 
nonlinear, 200 
particular solution, 191 
repeated roots, 188 
recurrence equations 

nonhomogeneous, 190 
recursive definition, 42 
reflexive, 340 
regular 

transition matrix, 315 
relation 

binary, 331, 340 
equivalence, 134, 344 
symmetric, 134 

sampling 

without replacement, 209 
scale, 300 
sequence, 17 
set, 327 

empty, 330 
finite, 333 
infinite, 333 

Zermelo-Fraenkel axioms, 352 
Sigma-notation 

definition of, 41 
sink, 253 
sorting, 47 
source, 253 
stabilizer, 294 
standard deviation, 216 
statement 


open, 49 
statements 

meaning of, 40 
string, 17 

binary, 18, 22, 181 
column sum, 317 
row sum, 317 

ternary, 18, 168, 169, 181, 187 
subdivision 

elementary, 92 
subgraph, 70 
induced, 70 
spanning, 70 
subposet, 118 
subset, 330 

proper, 330 
successor, 335 
Sudoku puzzle, 15 
surjection, 332 
symmetric, 344 

threshold probability, 231 
transitive, 340 
transposition 

of a scale, 300 
tree, 73 

binary, 201 
ordered, 201 
rooted, 201 
spanning, 73, 233 
unlabeled, 201 
trees 

labeled, 96 

union, 329 
up set, 124 

variance, 216 
vertex, 69 

walk, 71 
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weight, 233 

well ordered property, 40 


word, 17 
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